Skip to main content

 

Upgrade of Cluster VRA 8.x fails with Split brain scenario

Issue/Introduction

  • To successfully upgrade a vRA cluster.
Symptoms:
  • 3 node vRA cluster upgrade fails and each node tries to act as a separate cluster
  • upgrade-noop-error log shows vRA fails to make the upgrade directory :

[INFO][2022-08-05 19:16:01][xxxx.xxxxx.xxxx.xxxx] Preparing directory for upgrade data on remote node: [INFO][2022-08-05 19:16:01][xxxx.xxxxx.xxxx.xxxx] Running remote command: mkdir -p /var/vmware/prelude/upgrade at host: *

[ERROR][2022-08-05 19:16:01][xxxx.xxxxx.xxxx.xxxx][Exit Code: 255] Attempt failed to run command: mkdir -p /var/vmware/prelude/upgrade.

Environment

VMware vRealize Automation 8.x

Cause

  • This happens because the appliance fails to make the upgrade folder at "/var/vmware/prelude/upgrade" because the folder already exists from old upgrade attempts.

Resolution

  • There is a workaround. 


    Workaround:
    • The workaround steps are below: 
    1. Revert back to the snapshot before the upgrade.
    2. Remove the stale upgrade folder from each node : rm -r /var/vmware/prelude/upgrade
    3. Take new snapshots of the vRA nodes.
    4. Trigger the upgrade again.


    Additional Information

    Impact/Risks:
    • No major impact.
    Labels:

    Comments

    Post a Comment

    Popular posts from this blog

      Issue with Aria Automation Custom form Multi Value Picker and Data Grid https://knowledge.broadcom.com/external/article?articleNumber=345960 Products VMware Aria Suite Issue/Introduction Symptoms: Getting  error " Expected Type String but was Object ", w hen trying to use Complex Types in MultiValue Picker on the Aria for Automation Custom Form. Environment VMware vRealize Automation 8.x Cause This issue has been identified where the problem appears when a single column Multi Value Picker or Data Grid is used. Resolution This is a known issue. There is a workaround.  Workaround: As a workaround, try adding one empty column in the Multivalue picker without filling the options. So we can add one more column without filling the value which will be hidden(there is a button in the designer page that will hide the column). This way the end user will receive the same view.  
    Post a Comment
    Read more

    57 Tips Every Admin Should Know

    Active Directory 1. To quickly list all the groups in your domain, with members, run this command: dsquery group -limit 0 | dsget group -members –expand 2. To find all users whose accounts are set to have a non-expiring password, run this command: dsquery * domainroot -filter “(&(objectcategory=person)(objectclass=user)(lockoutTime=*))” -limit 0 3. To list all the FSMO role holders in your forest, run this command: netdom query fsmo 4. To refresh group policy settings, run this command: gpupdate 5. To check Active Directory replication on a domain controller, run this command: repadmin /replsummary 6. To force replication from a domain controller without having to go through to Active Directory Sites and Services, run this command: repadmin /syncall 7. To see what server authenticated you (or if you logged on with cached credentials) you can run either of these commands: set l echo %logonserver% 8. To see what account you are logged on as, run this command: ...
    Post a Comment
    Read more
      The Guardrails of Automation VMware Cloud Foundation (VCF) 9.0 has redefined private cloud automation. With full-stack automation powered by Ansible and orchestrated through vRealize Orchestrator (vRO), and version-controlled deployments driven by GitOps and CI/CD pipelines, teams can build infrastructure faster than ever. But automation without guardrails is a recipe for risk Enter RBAC and policy enforcement. This third and final installment in our automation series focuses on how to secure and govern multi-tenant environments in VCF 9.0 with role-based access control (RBAC) and layered identity management. VCF’s IAM Foundation VCF 9.x integrates tightly with enterprise identity providers, enabling organizations to define and assign roles using existing Active Directory (AD) groups. With its persona-based access model, administrators can enforce strict boundaries across compute, storage, and networking resources: Personas : Global Admin, Tenant Admin, Contributor, Viewer Projec...
    Post a Comment
    Read more