Proxmox. Mount Ceph RBD image: различия между версиями
Cless (обсуждение | вклад) |
Cless (обсуждение | вклад) |
||
| Строка 1: | Строка 1: | ||
== Description == | == Description == | ||
Mount Ceph RBD device (for VM disks and Containers) | Mount Ceph RBD device (for VM disks and Containers)<blockquote>'''! IMPORTANT !''' | ||
Yes, Snapshots | Yes, Snapshots are supported. | ||
BUT! | |||
Snapshots work correctly ONLY if you create them '''WITH''' "'''Include RAM'''" CHECK. In this case you can create and rollback to created Snapshot. | |||
Snapshot '''WITH NO''' "'''Include RAM'''" CHECK rollback to previous Snapshot, that have RAM. | |||
I have no idea why does it happen. Maybe PVE or Ceph bug. Do something with that!</blockquote> | |||
== Links == | == Links == | ||
| Строка 44: | Строка 52: | ||
== Snapshots == | == Snapshots == | ||
=== RBD Snapshots '''with NO''' "'''Include RAM'''" Check. '''They DON'T rollback correctly'''! === | |||
Snapshots | |||
<code>rbd snap ls vm-100-disk-0 -p rbd01</code> | <code>rbd snap ls vm-100-disk-0 -p rbd01</code> | ||
SNAPID NAME SIZE PROTECTED TIMESTAMP | SNAPID NAME SIZE PROTECTED TIMESTAMP | ||
4 clean 5 GiB Mon Sep 12 12:03:18 2022 | 4 clean 5 GiB Mon Sep 12 12:03:18 2022 | ||
=== RBD Snapshots WITH "'''Include RAM'''" Check. They rollback correctly === | === RBD Snapshots '''WITH''' "'''Include RAM'''" Check. '''They rollback correctly'''! === | ||
<code>rbd ls -l rbd01</code> | <code>rbd ls -l rbd01</code> | ||
NAME SIZE PARENT FMT PROT LOCK | NAME SIZE PARENT FMT PROT LOCK | ||
Версия 08:27, 13 сентября 2022
Description
Mount Ceph RBD device (for VM disks and Containers)
! IMPORTANT !
Yes, Snapshots are supported.
BUT!
Snapshots work correctly ONLY if you create them WITH "Include RAM" CHECK. In this case you can create and rollback to created Snapshot.
Snapshot WITH NO "Include RAM" CHECK rollback to previous Snapshot, that have RAM.
I have no idea why does it happen. Maybe PVE or Ceph bug. Do something with that!
Links
https://pve.proxmox.com/wiki/Storage:_RBD
Proxmox CLI
Get user admin auth Keyring from Ceph server
mkdir /etc/pve/priv/ceph
scp ceph01.local:/etc/ceph/ceph.client.admin.keyring /etc/pve/priv/ceph/ceph-rbd01.keyring
And also copy files to /etc/ceph/. Otherwise RBD may not work correctly - you couldn't see RBD info at PVE serv in that case
scp ceph01.local:/etc/ceph/ceph.client.admin.keyring /etc/ceph/
scp ceph01.local:/etc/ceph/ceph.conf /etc/ceph/
Proxmox Web-interface
- Datacenter - Storage - Add RBD:
- ID: ceph-rbd01
- Pool: rbd01
- Monitor(s): 192.168.199.121 192.168.199.122 192.168.199.123 # IPs of ceph nodes with MONITORs
- User name: admin
- Keyring: <key> # Get keyring on the Ceph Server:
cat /etc/ceph/ceph.client.admin.keyring
Show RBD info. You can see it in the terminal of the Ceph Server AND in the PVE terminal
RBD info
RBD pools info
ceph osd lspools
1 .mgr 2 cephfs01_data 3 cephfs01_metadata 4 rbd01
rbd ls -p rbd01
ceph-rbd01 vm-100-disk-0
Snapshots
RBD Snapshots with NO "Include RAM" Check. They DON'T rollback correctly!
rbd snap ls vm-100-disk-0 -p rbd01
SNAPID NAME SIZE PROTECTED TIMESTAMP 4 clean 5 GiB Mon Sep 12 12:03:18 2022
RBD Snapshots WITH "Include RAM" Check. They rollback correctly!
rbd ls -l rbd01
NAME SIZE PARENT FMT PROT LOCK vm-100-disk-0 5 GiB 2 excl vm-100-disk-0@clean 5 GiB 2 vm-100-disk-0@s456_ready 5 GiB 2 vm-100-state-clean 442 MiB 2 vm-100-state-s456_ready 443 MiB 2