Page MenuHomeSoftware Heritage
Files F8393485

README.md
No OneTemporary
Actions

README.md
View Options

This purpose of these instructions is to run `tox -e py3` in an
environment that has access to a ceph cluster. It enables tests that
would be otherwise be skipped and increases code coverage.
The environment is composed of eight machines named ceph1 to ceph8.
# Installation
* pip install -r requirements.txt
* ansible-galaxy install geerlingguy.docker
# Create the machines
## libvirt
* ensure virsh is available
* ./build-vms.sh
If the internet cnx is slow it may take a while before the OSD show up
because they require downloading large docker images.
## fed4fire
### Create a base rspec specification.
* /opt/jFed/jFed-Experimenter
* In the General Tab
* Create an experiment (New)
* Add one Physical Node by dragging it
* Right click on the node and choose "Configure Node"
* Select testbed: Grid 5000
* Node => Specific hardware type: dahu-grenoble
* Disk image => Bullseye base
* Save under sample.rspec
* Manually edit to duplicate the nodes
### Run the experiment.
* /opt/jFed/jFed-Experimenter
* In the General Tab
* Open Local and load winery-test-environment/fed4fire.rspec
* Edit ceph1 node to check if the Specific hardware type is dahu-grenoble
* Click on Topology Viewer
* Run
* Give a unique name to the experiment
* Start experiment
* Once the provisionning is complete (Testing connectivity to resources on Grid5000) click "Export As"
* Choose "Export Configuration Management Settings"
* Save under /tmp/test.zip
* fed4fire.sh test.zip
# Install the machines
* ansible-playbook -i inventory context/setup.yml ceph.yml bootstrap.yml osd.yml tests.yml
# Run the tests
It copies the content of the repository and "ssh ceph1 tox -e py3"
* tox -e winery
# Login into a machine
For each host found in context/ssh-config
* ssh -i context/cluster_key -F context/ssh-config ceph1
# Run the benchmarks
The `tox -e winery` command is used to run the benchmarks with the desired parameters. Upon completion the raw data can be found in the `winery-test-environment/context/stats` directory and is displayed on the standard output as well as rendered in a graph, if a display is available (see the `winery-test-environment/render-stats.py` for the details).
### Example
* tox -e winery -- -s --log-cli-level=INFO -vvv -k test_winery_bench_real --winery-bench-duration 30 --winery-shard-max-size $((10 * 1024 * 1024)) --winery-bench-ro-worker-max-request 2000
### Get all benchmark flags
Run the following command and look for flags that start with `--winery-bench-`
* tox -e winery -- --help
# Destroy
## libvirt
* ./build-vms.sh stop $(seq 1 8)
## fed4fire
It will expire on its own

File Metadata

Mime Type
text/plain
Expires
Wed, Jun 4, 7:14 PM (4 d, 21 h ago)
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
3238976

Event Timeline

About · Developer information · Legal