Текущая версия на 13:42, 6 мая 2023

Description

Ok, we have a task to configure PVE Cluster, which consists of several PVE nodes, and we must have the following features:

A shared network storage, attached to an each node in the Cluster. The content of the storage must be synced between nodes immediately (if it is the same image (iSCSI or RBD, for example), attached to an each node), or with some delay (GlusterFS, for example).
We must have an opportunity to create VM on a network shared storage.
In case of failing a node, which contains VM, we must have an opportunity to run this VM on another node in the Cluster.

Configuring

First off, you need to configure PVE Cluster: Proxmox. Кластер

Ceph RBD storage

+ Snapshots work
+ Migration works

Creating Ceph RBD pool

Ceph. AlmaLinux 8. Ceph 17 Quincy. Ceph RBD image Create and Mount at Client

Attaching RBD to PVE (as a Shared storage)

Proxmox. Mount Ceph RBD image

Now you can create VM with RAW disk type.

iSCSI + LVM

- Snapshots DON'T work
+ Migration works

Create iSCSI-target. For example, at XigmaNAS or at Ceph

ZFS. Nas4free. Creating and mounting ZFS-Volume. Mount ZFS-Volume via ISCSI-target

Ceph. AlmaLinux 8. Ceph 17 Quincy. Ceph iSCSI-target create

Case 1. Attach iSCSI to PVE (as a Shared storage)

Proxmox. iSCSI + LVM storage mounting for VM store on a PVE-CLUSTER

Case 2. Attach iSCSI to PVE as a Shared LUN (separated disk for VM)

During adding iSCSI shared disk check "Use LUNs directly".

Now you are able to add the whole iSCSI-disk as a separated disk for the only one VM.

You can make instant Migration to any node in the Cluster.

But you still can't create Snapshots. So it's useless for some cases.

ZFS over iSCSI

+ Snapshots work (but you can only rollback to the LATEST snapshot, this is ZFS limitation, nothing you can do about it)
+ Migration works

Install ZFS

ZFS. Linux. Almalinux 8. ZFS installation

Configure iSCSI-target server and attach storage to PVE Cluster

Proxmox. ZFS-over-iSCSI network shared storage. PVE Cluster

@@ Строка 10: / Строка 10: @@
 == Ceph RBD storage ==
-<blockquote>'''+ Snapshots''' work
-'''+ Migration''' works</blockquote>Creating Ceph RBD pool
+* '''+ Snapshots''' work
+* '''+ Migration''' works
+Creating Ceph RBD pool
 [[Ceph. AlmaLinux 8. Ceph 17 Quincy. Ceph RBD image Create and Mount at Client]]
@@ Строка 23: / Строка 25: @@
 == iSCSI + LVM ==
-<blockquote>'''- Snapshots''' DON'T work
-'''+ Migration''' works</blockquote>Create iSCSI-target. For example, at XigmaNAS or at Ceph
+* '''- Snapshots''' DON'T work
+* '''+ Migration''' works
+Create iSCSI-target. For example, at XigmaNAS or at Ceph
 [[ZFS. Nas4free. Creating and mounting ZFS-Volume. Mount ZFS-Volume via ISCSI-target]]
@@ Строка 31: / Строка 35: @@
 [[Ceph. AlmaLinux 8. Ceph 17 Quincy. Ceph iSCSI-target create]]
-Attach iSCSI to PVE (as a '''Shared''' storage)
+=== Case 1. Attach iSCSI to PVE (as a '''Shared''' storage) ===
+[[Proxmox. iSCSI + LVM storage mounting for VM store on a PVE-CLUSTER]]
+=== Case 2. Attach iSCSI to PVE as a Shared LUN (separated disk for VM) ===
+During adding iSCSI shared disk check '''"Use LUNs directly"'''.
-[[Proxmox. iSCSI + LVM storage mounting for VM store on a PVE-CLUSTER]]
+Now you are able to add the whole iSCSI-disk as a separated disk for the only one VM.
+You can make instant Migration to any node in the Cluster.
+But you still can't create Snapshots. So it's useless for some cases.
+== ZFS over iSCSI ==
+* '''+ Snapshots''' work (but you can only rollback to the LATEST snapshot, this is ZFS limitation, nothing you can do about it)
+* '''+ Migration''' works
+Install ZFS
+[[ZFS. Linux. Almalinux 8. ZFS installation]]
+Configure iSCSI-target server and attach storage to PVE Cluster
+[[Proxmox. ZFS-over-iSCSI network shared storage. PVE Cluster]]
 [[Категория:Proxmox]]
 [[Категория:ISCSI]]
@@ Строка 41: / Строка 64: @@
 __БЕЗ_РЕДАКТИРОВАНИЯ_РАЗДЕЛА__
 [[Категория:LVM]]
+[[Категория:ZFS]]

Proxmox. Cluster + Network shared storage: различия между версиями