Skip to main content

How to increase the heap memory of vRealize Orchestrator in Cloud Extensibility proxy

https://knowledge.broadcom.com/external/article?articleNumber=322717


Issue/Introduction

  • To increase the memory allocated to the vRealize Orchestrator server instance within the Cloud Extensibility proxy appliance. By default, the vRealize Orchestrator server is configured to use 3GB of memory.
  • Issue observed in Cloud Extensibility proxy 8.6.2 and earlier versions.
  • When the server is over-utilized and has to manage multiple workloads it crashes with the error, "OutOfMemoryErrors" in the vRealize Orchestrator console log directory: /services-logs/prelude/vco-app/console-logs/vco-server-app.log.
  • The following exception is thrown in the logs:
java.lang.OutOfMemoryError: Java heap space
Dumping heap to /usr/lib/vco/app-server/../app-server/logs/vco_2021-12-07_09:06_heap_dump.hprof ...
Heap dump file created [1697527497 bytes in 3.021 secs]
Terminating due to java.lang.OutOfMemoryError: Java heap space

Environment

VMware Aria Automation 8.x.x

Resolution

  • For Cloud Extensibility proxy version 8.7 or higher please refer to the "How to Scale the Heap Memory Size of the vRealize Orchestrator Server " article from the vRealize Orchestrator Product Documentation.
  • The URL provided in this article is for vRO 8.11, please use the Product Documentation for the Orchestrator product version matching the Cloud Extensibility proxy version.

Workaround:

NOTE: Please take note of the overall memory utilization of the VA prior to extending the Heap memory. It is important that enough memory is left available for the rest of the services so the VA resources have to be scaled up first.

Example: If the desired heap memory is 7g then the VA RAM should be increased with 4G respectively because the subtraction between the default heap value of 3g the desired heap memory is 4G.

  • Navigate to directory /data/upgrade/prelude/data/charts/vro
  • Edit the file values.tpl by adding the following property "serverJvmHeapMax: {desired_heap_memory}" where {desired_heap_memory} has to be the value of the required heap memory.

 Example: serverJvmHeapMax: 6g

  • Save the changes.
  • Run command:
prelude-vami-upgrade --force
  • Wait for the vco-app pod to be redeployed. You can monitor the status of the pod with the following command 
 kubectl -n prelude get pods -w

Important: Changes made in the file values.tpl are not persistent and they will be overwritten upon each next Cloud Release, therefore, the heap size value will be returned back to the default of 3g. It will be required to execute the above steps once again if the heap size has a value other than the default of 3g.

Comments

Popular posts from this blog

Quick Guide to VCF Automation for VCD Administrators

  Quick Guide to VCF Automation for VCD Administrators VMware Cloud Foundation 9 (VCF 9) has been  released  and with it comes brand new Cloud Management Platform –  VCF Automation (VCFA)  which supercedes both Aria Automation and VMware Cloud Director (VCD). This blog post is intended for those people that know VCD quite well and want to understand how is VCFA similar or different to help them quickly orient in the new direction. It should be emphasized that VCFA is a new solution and not just rebranding of an old one. However it reuses a lot of components from its predecessors. The provider part of VCFA called Tenenat Manager is based on VCD code and the UI and APIs will be familiar to VCD admins, while the tenant part inherist a lot from Aria Automation and especially for VCD end-users will look brand new. Deployment and Architecture VCFA is generaly deployed from VCF Operations Fleet Management (former Aria Suite LCM embeded in VCF Ops. Fleet Management...
  Issue with Aria Automation Custom form Multi Value Picker and Data Grid https://knowledge.broadcom.com/external/article?articleNumber=345960 Products VMware Aria Suite Issue/Introduction Symptoms: Getting  error " Expected Type String but was Object ", w hen trying to use Complex Types in MultiValue Picker on the Aria for Automation Custom Form. Environment VMware vRealize Automation 8.x Cause This issue has been identified where the problem appears when a single column Multi Value Picker or Data Grid is used. Resolution This is a known issue. There is a workaround.  Workaround: As a workaround, try adding one empty column in the Multivalue picker without filling the options. So we can add one more column without filling the value which will be hidden(there is a button in the designer page that will hide the column). This way the end user will receive the same view.  
  "Cloud zone insights not available yet, please check after some time" message on Aria Automation https://knowledge.broadcom.com/external/article?articleNumber=314894 Products VMware Aria Suite Issue/Introduction Symptoms: The certificate for Aria operations has been replaced since it was initially added to Aria Automation as an integration. When accessing the Insights pane under  Cloud Assembly  ->  Infrastructure  ->  Cloud Zone  ->  Insights  the following message is displayed:   "Cloud zone insights not available yet, please check after some time." The  /var/log/services-logs/prelude/hcmp-service-app/file-logs/hcmp-service-app.log  file contains ssl errors similar to:   2022-08-25T20:06:43.989Z ERROR hcmp-service [host='hcmp-service-app-xxxxxxx-xxxx' thread='Thread-56' user='' org='<org_id>' trace='<trace_id>' parent='<parent_id>' span='<span_id>'] c.v.a.h.a.common.AlertEnu...