BEE Backport regress/scripts/blab.py

BEE Backport regress/scripts/blab.py

This commit is the result of the squash of the following main commits:

Author: Alain Spineux <alain@baculasystems.com>
Date:   Wed Oct 16 19:28:20 2019 +0200

    regress: add a Dedup resource and make async.sh rebuild the SD plugins

Author: Alain Spineux <alain@baculasystems.com>
Date:   Wed Feb 28 15:50:40 2018 +0100

    regress: tweak blab.py

Author: Alain Spineux <alain@baculasystems.com>
Date:   Thu Feb 1 16:53:37 2018 +0100

    regress: add lab.CheckConfig() to blab.py to check FORCE_XXXX

    - check if FORCE_XXXX are set and skip (exit 0) if not appropriate.
    - add lab.Die("your message")
    - add lab.Exit(exit_code, ["your message"])

Author: Alain Spineux <alain@baculasystems.com>
Date:   Mon Aug 14 18:55:49 2017 +0200

    regress: dedup-checkoptions-test & blab.py update for new vacuum logging

Author: Alain Spineux <alain@baculasystems.com>
Date:   Mon Aug 14 13:49:58 2017 +0200

    regress: tweak dedup

    - arun.ini update to include all dedup tests
    - blab.py handle new scrub/vacuum logging

Author: Alain Spineux <alain@baculasystems.com>
Date:   Tue Aug 8 16:34:57 2017 +0200

    regress: improve tests/dedup-scrub-test.py, blap.py and querry_dde.py

    - dedup-scrub-test.py handle fake index entries
    - query_dde.py handle forged addresses
    - blap.py more definitions

Author: Alain Spineux <alain@baculasystems.com>
Date:   Mon Jul 10 13:41:30 2017 +0200

    regress: blab.py add minimal support for scrubber

    - add EZThread.AsyncStop0
    - add Dedupengine.GetContainerPath()
    - add minimal support for scrubber

Author: Alain Spineux <alain@baculasystems.com>
Date:   Tue May 30 16:32:21 2017 +0200

    regress: export QUERY_DDE_ADVANCED variable in blab.py

Author: Alain Spineux <alain@baculasystems.com>
Date:   Fri Apr 28 14:19:52 2017 +0200

    regress: adjust all .py scripts to blab.py and vacuum-ng

Author: Alain Spineux <alain@baculasystems.com>
Date:   Fri Apr 28 14:13:59 2017 +0200

    regress: improve and adjust blab.py for vacuum-ng

    - adjust blab.py for vacuum-ng output
    - kill -USR1 generate a stacktrace of running python thread
    - all .py scripts support --no-cleanup, --debug and --verbose options
    - support for 'dedup-simple' and 'dedup-autochanger' profiles
    - new blab.StartTest() and EndTest()
    - blab.GetJob(<negative value>)
    - blab.Log(logging.CTRITICAL, ) force a exit

Author: Alain Spineux <alain@baculasystems.com>
Date:   Mon Apr 24 14:57:34 2017 +0200

    regress: blab.py based on copy-dedup-confs instead of copy-plugin-confs

    - use DiskChanger instead (STORAGE=DiskChanger)
    - new EZThread base class for thread
    - add --no-cleanup PART 1
    - GetJob(jobid) and jobid=-1 instead of  GetJob(pos)
    - handle number like "12,345,567" with ','

Author: Alain Spineux <alain@baculasystems.com>
Date:   Fri Apr 21 15:03:22 2017 +0200

    regress: blab.py add ListMedia()

Author: Alain Spineux <alain@baculasystems.com>
Date:   Thu Apr 6 21:56:38 2017 +0200

    regress: blab.py add ListJobs() and ZapContainers()

    - ListJobs() return list jobs
    - GetJob(pos) return one job (use -1)
    - ZapContainers() fill all containers full of zeroes

Author: Alain Spineux <alain@baculasystems.com>
Date:   Fri Mar 24 14:49:12 2017 +0100

    blab.py parse dedup usage and more vacuum

    - parse dedup usage
    - parse vacuum "need optimize"
    - add some function helper to DDE

Author: Alain Spineux <alain@baculasystems.com>
Date:   Fri Dec 2 16:10:57 2016 +0100

    blab.py add BconsoleScriptOut()

    - BconsoleScriptOut() decode stdout
    - Add GetVar()
    - handle "exit" in the Shell

Author: Alain Spineux <alain@baculasystems.com>
Date:   Thu Nov 10 09:26:06 2016 +0100

    regress: improve blab.py

    - does stdout & stderr passthrough instead of active forwardin
    - accurate detection of the end of the shell commands
    - delete /tmp/std{out,err}XXXX using atexit

Author: Alain Spineux <alain@baculasystems.com>
Date:   Fri Oct 21 16:11:47 2016 +0200

    regress: make regress python friendly

    - modules like bconsole.py and blab.py goes in regress/scrips
    - regress/tests/regress.py is a helper that load modules in scripts
      without boring with librady path
    - py-sample-test.py is the first sample
    - add new objects lab.{fd,sd,dir} that are manage the related Daemon
    - add lab.sd.dde of class DDE that provides some basic helper for the DDE
    - file FileReader can search a log  or trace file
    - lab.GetVolume(volname) return information about a volume