Disaster recovery rehearsal in Continentalclusters

36
Troubleshooting DR rehearsal problems
This section describes the various problems that you can face while using DR rehearsal. The problems
are listed followed by the workaround or solution.
The “cmrecovercl d” fails to move a recovery group into maintenance mode
Follow the steps below to move a recovery group into maintenance mode even if the primary
package is halted.
1. Verify from stdout messages that the command failed because the primary package was
down. The operator can still proceed to move the recovery group in maintenance mode
by using the f force option, but has to make sure that a recovery is not in progress that is
described in step 2.
2. For Continentalclusters using Continuous Access P9000 or XP data replication, use the
pairdisplay command on any recovery cluster node and verify that the device group is
neither in PVOL-PAIR nor in SVOL-SSWS state.
Similarly for Continentalclusters using EMC SRDF data replication, use the symrdf
command on any recovery cluster node and verify that the a) devices are not R1 and b)
device group state is not “failed over”.
3. Use the f force option to move a recovery group into maintenance mode:
#cmrecovercl d f g <recovery group>
The “cmrecovercl g <recovery group>” fails if the recovery group is being
rehearsed or “cmrecovercl c” fails to recover those recovery groups that are
rehearsed
Follow the steps below to recover a recovery group which is in rehearsal. This procedure is
highlighted using recovery groups sales_rac9i_recgp_1 and sales_rac9i_recgp_2, as an example.
1. Verify from stdout messages that the command failed because the recovery group was in
maintenance mode as shown below.
$) cmrecovercl -g sales_rac9i_recgp_1
Failed to start recovery package <Houston/ sales_rac9i_recpkg_1> for the Recovery
Group <sales_rac9i_recgp_1> since it is in Maintenance Mode
$) cmrecovercl -g sales_rac9i_recgp_2
Failed to start recovery package <Houston/ sales_rac9i_recpkg_2> for the Recovery
Group <sales_rac9i_recgp_2> since it is in Maintenance Mode
2. Stop both the rehearsal packages.
$) cmhaltpkg sales_rac9i_rhpkg_1
$) cmhaltpkg sales_rac9i_rhpkg_2