/
Working with Dedicated Compute Cluster

Working with Dedicated Compute Cluster

Important

From Kyvos 2025.4 onwards, the High Availability of Compute Server process for Dedicated compute cluster support has been added. This ensures continuous service availability and automatically recovers from unexpected downtimes.

In case of an existing deployment upgraded to version 2025.4, you must update the PostCreationDedicatedCompute script. Follow the case 2 as specified for all cloud platforms (AWS, Azure, and GCP), and delete the existing attached script.

Creating a dedicated compute cluster

You can create a dedicated compute cluster either by downloading the JSON file or manually creating compute cluster.

For AWS

Supported dedicated compute instance types

  • Graviton: m6g.4xlarge

  • Non graviton: m5.4xlarge

  • Disk size: 250GB

Case 1: By downloading the ‘PostCreationDedicatedComputeAWS.json’ template

Note

If you use ARM architecture instances (Graviton) for Kyvos, you must also use them for dedicated compute, similarly for non-Graviton instances.

The following permission must be manually added to the Lambda role. You can remove the permissions once the external dedicated compute is created from the stack.

  • In the case of post-configuration, the following permissions are required on the lambda role to create a separate autoscaling group.

    • CloudFormation:DescribeStacks: This is used to get stack tags.

    • ec2:DescribeLaunchTemplates: It is used to describe a launch template.

    • ec2:CreateLaunchTemplateVersion: This is used to create a new version of a launch template, as tags are not attached to the autoscaling group. Hence, provide tags using the lambda function.

    • ec2:ModifyLaunchTemplate: This is required to modify an existing launch template.

Once the above-mentioned permissions are added to the Lambda role, create a stack using the PostCreationDedicatedComputeAWS.json JSON file available in the AWS installation Files folder, which will create a dedicated auto-scaling group. After creating the stack, configure the dedicated compute from the Compute Cluster page using Kyvos Manager.

  1. Download the PostCreationDedicatedComputeAWS.json JSON file available in the AWS installation Files folder.

  2. On the AWS CloudFormation Console, Create Stack > With New Resources (Standard) option.

  3. Step 1: Specify template

  4. In the Prerequisite - Prepare template, select the Choose an existing template option.

  5. In the Specify template,  select the Upload a template file option to upload your CloudFormation template using the Choose File button.

  6. Click NEXT.

  7. Step 2: Specify stack details

  8. Enter a Stack name. Stack name can contain letters (A-Z and a-z), numbers (0-9), and dashes (-). The Kyvos cluster will be deployed in this name, and you cannot edit the name after deployment.

  9. The Parameters area displays the configurations defined in your template. It also allows you to enter custom values to create or update a stack.

Parameter

Description

Parameter

Description

Subnets

Select the subnet to be attached to the Autoscaling Group. You must select two subnets from different availability zones.

Ec2IamRole

Enter the name of the EC2 IAM Role that will be attached to Autoscaling group instances.

NOTE: Use the same role which is used for KM Instance.

LambdaIamRole

Enter the name of the lambda IAM role that will be attached to Autoscaling group instances. Use the same role which is used for Kyvos Manager Instance.

InstanceSecurityGroupOtherVMs

Enter the ID of the security group attached to the BI Server.

BucketName

Enter the name of S3 bucket used in Kyvos deployment.
NOTE: Kyvos does not support dot in the S3 bucket name.

DedicatedComputeMaxNodes

The maximum desired dedicated compute cluster nodes.

CustomPrefixEc2

Enter the prefix you want to append to the names of EC2 instances of Autoscaling group used with Kyvos. The prefix can be up to 20 characters long and must begin and end with a word character.

PemFile

A key pair consisting of a public key (stored by AWS), and a private key file (stored by user). Together, they allow you to connect to your instance securely. Use the same key which was used in Kyvos deployment.

KyvosWorkDir

Enter the work directory path used in the Kyvos deployment.

GravitonInstance

Select true if the Instances type of Autoscaling group is graviton.

InstanceType

Instances type of Autoscaling group.

If the ‘GravitonInstance’ parameter is true, use r6g.4xlarge instance type.

CustomAMI

Select true if the Dedicated Compute instance will be created using custom image.

AmiDefaultUserName

Fill this parameter only if parameter CustomAMI is true. Each Linux instance launches with a default Linux system user account. For more details, see AWS documentation.

AmiId

Fill this parameter only if the parameter CustomAMI is set to true.

Case 2: Manually creating a dedicated compute cluster

Step 1: Update the Launch Template or Launch Configuration
Cloud Init scripts are configured at instance launch update the Launch Template used in ASG.

To find the Launch Template associated with your Auto Scaling Group (ASG), perform the following steps:

  1. Open the EC2 Console.

  2.  Go to the AWS EC2 Console.

  3. Navigate to Auto Scaling Groups:

    1. On the left sidebar, click Auto Scaling Groups under the Auto Scaling section.

    2. Select Your ASG:

    3. Find and click on the name of the Auto Scaling Group you want to check.

  4. View Details:

    1. In the Details tab, look for Launch Template: Shows the template name and version (if using Launch Templates).

Update Launch Template:

  1. Log in to the AWS and navigate to EC2.

  2. Select Launch Templates from the left pane.

  3. Find your template and choose Actions > Modify Template (Create new version).

  4. In Advanced Details, locate the User data section.

  5. Paste the content of mannualCreationDedicatedComputeUserData.sh (available in AWS Installation Files folder) script here.

  6. Save the new version.

Step 2: Update Auto Scaling Group to Use the New Template/Configuration

  1. Go to Auto Scaling Groups in the EC2 console.

  2. Select your ASG and click Edit.

  3. Under Launch template version, choose Latest version or the specific version you created.

  4. Save changes.

NEXT: Refer to the wizard-based deployment section for further details on deploying Kyvos.

For Azure

Note

The resource group of the dedicated compute cluster must be the same as the Kyvos cluster deployment resource group.

Supported dedicated compute instance types

  • Dsv4 size series (recommended Standard D16s v4) 

  • Disk Size (recommended 250GB)

CASE 1: By downloading the ‘DedicatedCompute_VMSS’ JSON file

  1. Download the PostCreationDedicatedComputeAzure JSON file available in the Azure Installation Files folder.

  2. Log in to Azure portal.

  3. Search for ‘Deploy a custom template’ in the search bar.

  4. Upload the downloaded JSON file.

  5. Provide the same parameter that you mentioned while creating Kyvos cluster.

CASE 2: Manually creating a dedicated compute cluster

  1. Go to Azure Portal. 

  2. Click On create a virtual Machine Scale Set (VMSS).

  3. Select Subscription, Resource Group, and provide the Virtual Machine Scale Set name.

  4. Orchestration mode for Dedicated Compute Cluster must be Uniform only.

  5. Verify that the instance count must be 0.

  6. From the Image drop-down, choose the supported RHEL version from the list.

    • Red Hat Enterprise Linux 8.6 - Gen 2 option (recommended).

    • Red Hat Enterprise Linux 9.4 - Gen 2

    • Red Hat Enterprise Linux 7.8 - Gen 1

  7. Once the machine is created, you must attach the Managed Identity that is used for the deployment stack.

  8. Add the following tags to the created VMSS.

    1. ROLE: KYVOS_COMPUTE_CLUSTER

    2. LAYER: Cube_Build

  9. Download the Dedicated_Compute.sh script located in the Azure Installation Files folder.

  10. In the script, update the blank parameters that required deployment-specific information.

  11. Fill the information for those parameters.

  12. Now, convert the script in base64 encryption.

  13. Update the resource group name, VMSS name, and the script value in the command and then execute it.

    az vmss extension set \ --resource-group <RESOURCE_GROUP_NAME> \ --vmss-name <VIRTUAL_MACHINE_SCALE_SET_NAME> \ --name CustomScript \ --publisher Microsoft.Azure.Extensions \ --no-auto-upgrade false \ --version 2.0 \ --settings '{"script":"<BASE_64_FORMAT_OF_SCRIPT>"}'

It will add extension to the VMSS and whenever any instance will launch, it will download the prerequisites on the instance.

NEXT:

For GCP

Note

The working directory and bucket name used by the dedicated compute must be the same as the deployment.

Case 1: By downloading the terraform.tar bundle file

  1. Download the terraform.tar bundle file, which is available in the GCP Installation Files folder.

  2. Log in to GCP portal and upload the terraform.tar bundle file to cloud shell.

  3. Navigate to conf folder and open the kyvosparams.tfvars file.

  4. In the file, set the value of the dedicatedCompute parameter to true. Also, set the value of other parameters to false.

  5. Now, go to the bin folder and execute the deploy.sh file.

CASE 2: Manually creating a dedicated compute cluster

  1. Log in to GCP portal and navigate to the Instance Group.

  2. Select the Instance Group that you want to modify.

  3. In the selected instance group, find the associated Instance Template.
    Note that you cannot directly edit an existing template.

  4. Since existing templates cannot be edited, click Create Similar to duplicate the current template.

  5. Modify the PostCreationDedicatedComputeGCP.sh available in the GCP Installation Files folder.

  6. In this script, modify the required details for the ZONE, BUCKET_NAME and KYVOS_WORK_DIR, DATA_VOLUME_DISK_SIZE and save the changes.

  7. In the newly created template, under the Management section, go to Automation.

  8. Update the bootstrap script with the content of modified PostCreationDedicatedComputeGCP.sh and click Create.

  9. Attach the Updated Instance Template to the instance group.

This process will create a new instance template with your required modifications and ensure that the changes are applied to the instance group accordingly.

NEXT: Refer to the wizard-based deployment section for further details on deploying Kyvos.

Copyright Kyvos, Inc. 2025. All rights reserved.