Page MenuHomeSoftware Heritage
Paste P406

dbs inventory per postgres cluster
ActivePublic
Actions

Authored by ardumont on May 23 2019, 3:46 PM.
#+title: dbs
Dbs inventory so far.
Order by node name/cluster:port
* Prado
** cluster: main:5433
|------------------+----------+---------+--------------------------------------------------------------|
| Name | Owner | Size | Description |
|------------------+----------+---------+--------------------------------------------------------------|
| softwareheritage | postgres | 8096 GB | softwareheritage main database (listers/loaders write to it) |
|------------------+----------+---------+--------------------------------------------------------------|
** cluster: secondary:5434
|------------------------------------+------------------+---------+------------------------------------------------|
| Name | Owner | Size | Description |
|------------------------------------+------------------+---------+------------------------------------------------|
| lister-bitbucket | lister-bitbucket | 8627 kB | |
| lister-debian | lister-debian | 1930 MB | |
| lister-github | postgres | 131 GB | |
| lister-gitlab | lister-gitlab | 664 MB | |
| lister-npm | lister-npm | 731 MB | |
| lister-pypi | lister-pypi | 98 MB | |
| softwareheritage-archiver | postgres | 1240 GB | |
| softwareheritage-deposit | swhstorage | 10 MB | |
| softwareheritage-scheduler | swhscheduler | 407 GB | |
| softwareheritage-scheduler-updater | swhscheduler | 170 MB | |
| swh-vault | swh-vault | 378 MB | |
| zack | zack | 9435 kB | |
| zack-swh-sample | zack | 5076 MB | zack's playground copy of (a subset of) SWH DB |
|------------------------------------+------------------+---------+------------------------------------------------|
** cluster: hdd:5435
|---------------------------+------------+---------+-----------------------------------------------------|
| Name | Owner | Size | Description |
|---------------------------+------------+---------+-----------------------------------------------------|
| lister-github | postgres | 55 GB | Probably a left-over that can be dropped |
| | | | as the main lister github is on 'secondary cluster' |
| snapshot.debian.org | postgres | 10 GB | |
| softwareheritage-archiver | swhstorage | 571 GB | softwareheritage-archiver |
| softwareheritage-log | postgres | 1177 GB | |
|---------------------------+------------+---------+-----------------------------------------------------|
* somerset
** cluster: replica:5433
|------------------+------------+---------+---------------------------------------------------|
| Name | Owner | Size | Description |
|------------------+------------+---------+---------------------------------------------------|
| softwareheritage | swhstorage | 5202 GB | Main replica for the archive.s.o site (read-only) |
|------------------+------------+---------+---------------------------------------------------|
** cluster: indexer:5434
|--------------------------+------------+---------+--------------------------------------------|
| Name | Owner | Size | Description |
|--------------------------+------------+---------+--------------------------------------------|
| softwareheritage-indexer | swhstorage | 1159 GB | Softwareheritage main indexer db |
|--------------------------+------------+---------+--------------------------------------------|
** cluster: testdedup:5435
|----------------+----------+---------+--------------------------------------------|
| Name | Owner | Size | Description |
|----------------+----------+---------+--------------------------------------------|
| swh-dedup | seirl | 526 GB | |
| swh-dedup-cont | seirl | 378 GB | |
|----------------+----------+---------+--------------------------------------------|
** cluster: occurrences:5436
|------------------+------------+---------+--------------------------------------------------------|
| Name | Owner | Size | Description |
|------------------+------------+---------+--------------------------------------------------------|
| softwareheritage | swhstorage | 231 GB | Old tables used by @grouss for the provenance use case |
|------------------+------------+---------+--------------------------------------------------------|
* Notes
The following dbs were removed from each cluster listing (as they were roughly
the same size everywhere):
|------------------+----------+---------+--------------------------------------------------------------|
| postgres | postgres | 8075 kB | default administrative connection database |
| template0 | postgres | 7979 kB | unmodifiable empty database |
| | | | |
| template1 | postgres | 8011 kB | default template for new databases |
|------------------+----------+---------+--------------------------------------------------------------|

Event Timeline

ardumont created this paste.May 23 2019, 3:46 PM
ardumont mentioned this in Unknown Object (Maniphest Task).
ardumont changed the title of this paste from db inventory to dbs inventory per cluster.
ardumont changed the title of this paste from dbs inventory per cluster to dbs inventory per postgres cluster.
ardumont updated the paste's language from autodetect to text.
ardumont added a project: System administration.
ardumont mentioned this in T1745: DB inventory and documentation.May 23 2019, 3:55 PM
ardumont added a comment.May 23 2019, 5:54 PM

This org-mode source got exported to mediawiki.

There is now a documented wiki page for it [1]

[1] https://intranet.softwareheritage.org/wiki/Databases_inventory

About · Developer information · Legal