ci: add rook-ceph cluster ci test

[subhamkrai]

Describe what this PR does

Provide some context for the reviewer

Is there anything that requires special attention

Do you have any questions?

Is the change backward compatible?

Are there concerns around backward compatibility?

Provide any external context for the change, if any.

For example:

• Kubernetes links that explain why the change is required
• Ceph-CSI spec related changes/catch-up that necessitates this patch
• golang related practices that necessitates this change

Related issues

Mention any github issues relevant to this PR. Adding below line
will help to auto close the issue once the PR is merged.

Fixes: #issue_number

Future concerns

List items that are not part of the PR and do not impact it's
functionality, but are work items that can be taken up subsequently.

Checklist:

• Commit Message Formatting: Commit titles and messages follow
  guidelines in the developer
  guide.
• Reviewed the developer guide on Submitting a Pull
  Request
• Pending release
  notes
  updated with breaking and/or notable changes for the next major release.
• Documentation has been updated, if necessary.
• Unit tests have been added, if necessary.
• Integration tests have been added, if necessary.

[subhamkrai]

Testing looks good @Madhu-1. Let me what else I need in this PR

runner@fv-az1426-553:~/work/ceph-csi-operator/ceph-csi-operator$ kubectl get pods -n rook-ceph

NAME                                                READY   STATUS        RESTARTS   AGE
csi-cephfsplugin-provisioner-76b7548bfb-jw6qr       5/5     Running       0          63s
csi-cephfsplugin-wltc4                              2/2     Running       0          63s
csi-rbdplugin-5zppz                                 2/2     Running       0          63s
csi-rbdplugin-provisioner-744cd895d5-tbd5n          5/5     Running       0          63s
rook-ceph-exporter-fv-az1426-553-5c5d75bb48-77cvb   1/1     Terminating   0          33s
rook-ceph-mgr-a-77f5d6dcc7-cf5z8                    1/1     Running       0          33s
rook-ceph-mon-a-c7cbff6f7-t5g9n                     1/1     Running       0          82s
rook-ceph-mon-b-5455d8fb77-46px5                    1/1     Running       0          58s
rook-ceph-mon-c-675b896c-hcfd2                      1/1     Running       0          47s
rook-ceph-operator-757cdc49bb-p2j47                 1/1     Running       0          2m8s
rook-ceph-osd-0-5765bf69d8-ckvnq                    0/1     Init:0/3      0          3s
rook-ceph-osd-prepare-fv-az1426-553-6d9sq           0/1     Completed     0          11s
runner@fv-az1426-553:~/work/ceph-csi-operator/ceph-csi-operator$ 
runner@fv-az1426-553:~/work/ceph-csi-operator/ceph-csi-operator$ kubectl  get cephcluster -n rook-ceph
NAME         DATADIRHOSTPATH   MONCOUNT   AGE    PHASE   MESSAGE                        HEALTH      EXTERNAL   FSID
my-cluster   /var/lib/rook     3          2m1s   Ready   Cluster created successfully   HEALTH_OK              eb96c8fc-b615-4c64-a3f8-ea1143dd528c
runner@fv-az1426-553:~/work/ceph-csi-operator/ceph-csi-operator$ 

runner@fv-az1426-553:~/work/ceph-csi-operator/ceph-csi-operator$ kubectl  -n rook-ceph exec -it rook-ceph-tools-58c6857df4-vbj55 -- sh
sh-4.4$ ceph -s
  cluster:
    id:     eb96c8fc-b615-4c64-a3f8-ea1143dd528c
    health: HEALTH_OK
 
  services:
    mon: 3 daemons, quorum a,b,c (age 5m)
    mgr: a(active, since 3m)
    osd: 1 osds: 1 up (since 4m), 1 in (since 4m)
 
  data:
    pools:   1 pools, 32 pgs
    objects: 2 objects, 463 KiB
    usage:   27 MiB used, 75 GiB / 75 GiB avail
    pgs:     32 active+clean

[Madhu-1]

small nits, LGTM