You are here

SG Modify cluster configuration with one node down

I had this problem with and old cluster:

I have a 3 node cluster with hp-ux 11.11 and sg 11.15, one of the nodes(node1) in the cluster is down, and deleted for good, never comming back.

The problem I have is pkg A , has configured as failover nodes node 1 and node2, now that node1 is gone, I need to configure node2 and node3 as failover packages in pkgA.

The problem is with node1 down i can't modify hte package, i get:

> cmcheckconf -v -P pkgA

Checking existing configuration ... Done
Gathering configuration information ... Done
Parsing package file: pkgA.conf.
Package bqmp already exists. It will be modified.
Error: Run script /etc/cmcluster/pkgB/pkgB.cntl for package pkgB
does not exist on node node1.
Error: Run script /etc/cmcluster/pkgC/pkgC.cntl for package pkgC
does not exist on node centauro2.
Maximum configured packages parameter is 20.
Configuring 5 package(s).
15 package(s) can be added to this cluster.
cmcheckconf : Unable to verify package.

I also can't delete the pkg and recreate ir again because node1 is down:

cmdeleteconf -v -f -p pkga
cmdeleteconf : Unable to delete the packages.
Error: Cannot connect to configuration daemon (cmclconfd) on node node1
Error: A temporary configuration file ($SGCONF/cmclconfig.tmp) cannot be written to disk on one or more nodes: No such file or directory
Error: Cannot connect to configuration daemon (cmclconfd) on node node1
Error: A temporary configuration file ($SGCONF/cmclconfig.tmp) cannot be removed from one or more nodes: No such file or directory
Error: Unable to apply the configuration change: No such file or directory
. Check the syslog file(s) for additional information.

So i can't delete node1 from the cluster config, because it has packages with node1 configured as a failover node...

cmcheckconf -v -k -C cmclconf.ascii

Checking cluster file: cmclconf.ascii
Checking nodes ... Done
Checking existing configuration ... Done
Gathering configuration information ... Done
Gathering configuration information ... Done
Gathering configuration information ................ Done
Cluster sdcrm is an existing cluster
Checking for inconsistencies .. Done
Cluster sdcrm is an existing cluster
Error: Package pkgA requires a node that is not configured in the cluster
Error: Package pkgB requires a node that is not configured in the cluster
Error: Package pkgC requires a node that is not configured in the cluster
Maximum configured packages parameter is 20.
Configuring 5 package(s).
15 package(s) can be added to this cluster.
cmcheckconf : Unable to verify cluster file: cmclconf.ascii

I have no way of restoring node1, is there I way of getting this working without stoping the cluster??.

SOLUTION:

I finally found out the way to do it, you have to run all the modifications at the sametime, there is no need to stop the cluster

In the same command I delete node1 from the cluster, and also modify the packages removing node1 as a failover node in all the packages, and also adding node3 as a new failover node.

Example:

#cmapplyconf -v -k -C cluster.ascii -p pkgA/pkgA.conf -p pkgB/pkgB.conf -p pkgC/pkgC.conf

Unix Systems: 

Add new comment

Filtered HTML

  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <blockquote> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
By submitting this form, you accept the Mollom privacy policy.
Error | HP-UX Tips & Tricks Site

Error

Error message

  • Warning: Cannot modify header information - headers already sent by (output started at /homepages/37/d228974590/htdocs/includes/common.inc:2567) in drupal_send_headers() (line 1207 of /homepages/37/d228974590/htdocs/includes/bootstrap.inc).
  • PDOException: SQLSTATE[42000]: Syntax error or access violation: 1142 INSERT command denied to user 'dbo229817041'@'217.160.155.192' for table 'watchdog': INSERT INTO {watchdog} (uid, type, message, variables, severity, link, location, referer, hostname, timestamp) VALUES (:db_insert_placeholder_0, :db_insert_placeholder_1, :db_insert_placeholder_2, :db_insert_placeholder_3, :db_insert_placeholder_4, :db_insert_placeholder_5, :db_insert_placeholder_6, :db_insert_placeholder_7, :db_insert_placeholder_8, :db_insert_placeholder_9); Array ( [:db_insert_placeholder_0] => 0 [:db_insert_placeholder_1] => cron [:db_insert_placeholder_2] => Attempting to re-run cron while it is already running. [:db_insert_placeholder_3] => a:0:{} [:db_insert_placeholder_4] => 4 [:db_insert_placeholder_5] => [:db_insert_placeholder_6] => http://www.hpuxtips.es/?q=content/sg-modify-cluster-configuration-one-node-down [:db_insert_placeholder_7] => [:db_insert_placeholder_8] => 54.198.71.184 [:db_insert_placeholder_9] => 1503243262 ) in dblog_watchdog() (line 157 of /homepages/37/d228974590/htdocs/modules/dblog/dblog.module).
The website encountered an unexpected error. Please try again later.