Proxmox. Cluster + Network shared storage

Description

Ok, we have a task to configure PVE Cluster, which consists of several PVE nodes, and we must have the following features:

• A shared network storage, attached to an each node in the Cluster. The content of the storage must be synced between nodes immediately (if it is the same image (iSCSI or RBD, for example), attached to an each node), or with some delay (GlusterFS, for example).
• We must have an opportunity to create VM on a network shared storage.
• In case of failing a node, which contains VM, we must have an opportunity to run this VM on another node in the Cluster.

Configuring

First off, you need to configure PVE Cluster: Proxmox. Кластер

Ceph RBD storage

• + Snapshots work
• + Migration works

Creating Ceph RBD pool

Ceph. AlmaLinux 8. Ceph 17 Quincy. Ceph RBD image Create and Mount at Client

Attaching RBD to PVE (as a Shared storage)

Proxmox. Mount Ceph RBD image

Now you can create VM with RAW disk type.

iSCSI + LVM

• - Snapshots DON'T work
• + Migration works

Create iSCSI-target. For example, at XigmaNAS or at Ceph

ZFS. Nas4free. Creating and mounting ZFS-Volume. Mount ZFS-Volume via ISCSI-target

Ceph. AlmaLinux 8. Ceph 17 Quincy. Ceph iSCSI-target create

Attach iSCSI to PVE (as a Shared storage)

Proxmox. iSCSI + LVM storage mounting for VM store on a PVE-CLUSTER

ZFS over iSCSI

• + Snapshots work (but you can only rollback to the LATEST snapshot, this is ZFS limitation, nothing you can do about it)
• + Migration works

iSCSI-target server

For example, we will use Almalinux 8 as a iscsi-target with ZFS pool

Install ZFS

ZFS. Linux. Almalinux 8. ZFS installation

Configure iSCSI-target server and attach storage to PVE Cluster

Proxmox. ZFS-over-iSCSI network shared storage. PVE Cluster