RHCEPHQE-17760: [IO Tool Integration] - Including postgresIO on FUSE

[Manimaran-MM]

Description

This PR is enhancement of #4406

Changes from Previous PR

• Simplified postgresql deployment

Steps to configure PostgresIO (from client node):

1. Create a directory for PostgreSQL data on Client node under the mounted directory
2. sudo mkdir -p /mnt/mani_fs_1/postgres_data
3. Provide postgres user access to the folder
4. chown -R postgres:postgres /mnt/mani_fs_1/postgres_data
5. chmod 700 /mnt/mani_fs_1/postgres_data
6. Run postgresql as a container with mount point as the data directory
   podman run -d --name postgres
   -e POSTGRESQL_USER=pguser
   -e POSTGRESQL_PASSWORD=pgpassword
   -e POSTGRESQL_DATABASE=pgbench
   -v /mnt/mani_fs_1/postgres_data:/var/lib/pgsql/data
   -p 5432:5432
   registry.redhat.io/rhel8/postgresql-13
7. podman exec -it postgres bash -c "pgbench -i -U pguser -d pgbench"
8. podman exec -it postgres bash -c "pgbench -c 10 -j 2 -T 60 -U pguser -d pgbench"

Code Changes - Summary

• tests/cephfs/cephfs_IO_lib.py
  • Deploy postgresql as a container using podman
  • Include function to handle cleanup
  • Migrate existing dbench and postgresIO function to this function
• tests/cephfs/cephfs_utilsV1.py
  • Handle Postgres IO and dbench function in the new fucntion(as above)
• tests/cephfs/cephfs_vol_management/cephfs_vol_mgmt_fs_create_delete_loop.py
  • Include new subvolume
  • Add logic for PostgresIO using FUSE mount
  • Handle cleanup

Pass Logs:

• http://magna002.ceph.redhat.com/ceph-qe-logs/manim/logs/RHCEPHQE-17760-rerun-individual/
• http://magna002.ceph.redhat.com/ceph-qe-logs/manim/logs/RHCEPHQE-17760-rerun/
• http://magna002.ceph.redhat.com/ceph-qe-logs/manim/logs/RHCEPHQE-17760/

click to expand checklist

• Create a test case in Polarion reviewed and approved.
• Create a design/automation approach doc. Optional for tests with similar tests already automated.
• Review the automation design
• Implement the test script and perform test runs
• Submit PR for code review and approve
• Update Polarion Test with Automation script details and update automation fields
• If automation is part of Close loop, update BZ flag qe-test_coverage “+” and link Polarion test

[openshift-ci-robot]

@Manimaran-MM: This pull request references RHCEPHQE-17760 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "odf-4.18" version, but no target version was set.

In response to this:

Description

This PR is enhancement of #4406

Changes from Previous PR

• Simplified postgresql deployment

Steps to configure PostgresIO (from client node):

1. Create a directory for PostgreSQL data on Client node under the mounted directory
2. sudo mkdir -p /mnt/mani_fs_1/postgres_data
3. Provide postgres user access to the folder
4. chown -R postgres:postgres /mnt/mani_fs_1/postgres_data
5. chmod 700 /mnt/mani_fs_1/postgres_data
6. Run postgresql as a container with mount point as the data directory
   podman run -d --name postgres
   -e POSTGRESQL_USER=pguser
   -e POSTGRESQL_PASSWORD=pgpassword
   -e POSTGRESQL_DATABASE=pgbench
   -v /mnt/mani_fs_1/postgres_data:/var/lib/pgsql/data
   -p 5432:5432
   registry.redhat.io/rhel8/postgresql-13
7. podman exec -it postgres bash -c "pgbench -i -U pguser -d pgbench"
8. podman exec -it postgres bash -c "pgbench -c 10 -j 2 -T 60 -U pguser -d pgbench"

Code Changes - Summary

• tests/cephfs/cephfs_utilsV1.py
  • Deploy postgresql as a container using podman
  • Include function to handle cleanup
• tests/cephfs/cephfs_vol_management/cephfs_vol_mgmt_fs_create_delete_loop.py
  • Include new subvolume
  • Add logic for PostgresIO using FUSE mount
  • Handle cleanup

Pass Logs:

• http://magna002.ceph.redhat.com/ceph-qe-logs/manim/logs/RHCEPHQE-17760/

click to expand checklist

• Create a test case in Polarion reviewed and approved.
• Create a design/automation approach doc. Optional for tests with similar tests already automated.
• Review the automation design
• Implement the test script and perform test runs
• Submit PR for code review and approve
• Update Polarion Test with Automation script details and update automation fields
• If automation is part of Close loop, update BZ flag qe-test_coverage “+” and link Polarion test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[openshift-ci-robot]

@Manimaran-MM: This pull request references RHCEPHQE-17760 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "odf-4.18" version, but no target version was set.

In response to this:

Description

This PR is enhancement of #4406

Changes from Previous PR

• Simplified postgresql deployment

Steps to configure PostgresIO (from client node):

1. Create a directory for PostgreSQL data on Client node under the mounted directory
2. sudo mkdir -p /mnt/mani_fs_1/postgres_data
3. Provide postgres user access to the folder
4. chown -R postgres:postgres /mnt/mani_fs_1/postgres_data
5. chmod 700 /mnt/mani_fs_1/postgres_data
6. Run postgresql as a container with mount point as the data directory
   podman run -d --name postgres
   -e POSTGRESQL_USER=pguser
   -e POSTGRESQL_PASSWORD=pgpassword
   -e POSTGRESQL_DATABASE=pgbench
   -v /mnt/mani_fs_1/postgres_data:/var/lib/pgsql/data
   -p 5432:5432
   registry.redhat.io/rhel8/postgresql-13
7. podman exec -it postgres bash -c "pgbench -i -U pguser -d pgbench"
8. podman exec -it postgres bash -c "pgbench -c 10 -j 2 -T 60 -U pguser -d pgbench"

Code Changes - Summary

• tests/cephfs/cephfs_IO_lib.py
  • Deploy postgresql as a container using podman
  • Include function to handle cleanup
  • Migrate existing dbench and postgresIO function to this function
• tests/cephfs/cephfs_utilsV1.py
  • Handle Postgres IO and dbench function in the new fucntion(as above)
• tests/cephfs/cephfs_vol_management/cephfs_vol_mgmt_fs_create_delete_loop.py
  • Include new subvolume
  • Add logic for PostgresIO using FUSE mount
  • Handle cleanup

Pass Logs:

• http://magna002.ceph.redhat.com/ceph-qe-logs/manim/logs/RHCEPHQE-17760-rerun/
• http://magna002.ceph.redhat.com/ceph-qe-logs/manim/logs/RHCEPHQE-17760/

click to expand checklist

• Create a test case in Polarion reviewed and approved.
• Create a design/automation approach doc. Optional for tests with similar tests already automated.
• Review the automation design
• Implement the test script and perform test runs
• Submit PR for code review and approve
• Update Polarion Test with Automation script details and update automation fields
• If automation is part of Close loop, update BZ flag qe-test_coverage “+” and link Polarion test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[openshift-ci-robot]

@Manimaran-MM: This pull request references RHCEPHQE-17760 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "odf-4.18" version, but no target version was set.

In response to this:

Description

This PR is enhancement of #4406

Changes from Previous PR

• Simplified postgresql deployment

Steps to configure PostgresIO (from client node):

1. Create a directory for PostgreSQL data on Client node under the mounted directory
2. sudo mkdir -p /mnt/mani_fs_1/postgres_data
3. Provide postgres user access to the folder
4. chown -R postgres:postgres /mnt/mani_fs_1/postgres_data
5. chmod 700 /mnt/mani_fs_1/postgres_data
6. Run postgresql as a container with mount point as the data directory
   podman run -d --name postgres
   -e POSTGRESQL_USER=pguser
   -e POSTGRESQL_PASSWORD=pgpassword
   -e POSTGRESQL_DATABASE=pgbench
   -v /mnt/mani_fs_1/postgres_data:/var/lib/pgsql/data
   -p 5432:5432
   registry.redhat.io/rhel8/postgresql-13
7. podman exec -it postgres bash -c "pgbench -i -U pguser -d pgbench"
8. podman exec -it postgres bash -c "pgbench -c 10 -j 2 -T 60 -U pguser -d pgbench"

Code Changes - Summary

• tests/cephfs/cephfs_IO_lib.py
  • Deploy postgresql as a container using podman
  • Include function to handle cleanup
  • Migrate existing dbench and postgresIO function to this function
• tests/cephfs/cephfs_utilsV1.py
  • Handle Postgres IO and dbench function in the new fucntion(as above)
• tests/cephfs/cephfs_vol_management/cephfs_vol_mgmt_fs_create_delete_loop.py
  • Include new subvolume
  • Add logic for PostgresIO using FUSE mount
  • Handle cleanup

Pass Logs:

• http://magna002.ceph.redhat.com/ceph-qe-logs/manim/logs/RHCEPHQE-17760-rerun-individual/
• http://magna002.ceph.redhat.com/ceph-qe-logs/manim/logs/RHCEPHQE-17760-rerun/
• http://magna002.ceph.redhat.com/ceph-qe-logs/manim/logs/RHCEPHQE-17760/

click to expand checklist

• Create a test case in Polarion reviewed and approved.
• Create a design/automation approach doc. Optional for tests with similar tests already automated.
• Review the automation design
• Implement the test script and perform test runs
• Submit PR for code review and approve
• Update Polarion Test with Automation script details and update automation fields
• If automation is part of Close loop, update BZ flag qe-test_coverage “+” and link Polarion test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[AmarnatReddy]

LGTM

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: AmarnatReddy, Manimaran-MM

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment