Managing Cluster

This section contains details about a cluster created for Kyvos, which is a set of resources created in the Kyvos-managed AWS environment. It includes functionalities related to subscriptions, namely creating, viewing, deleting, starting/stopping, and viewing history for any cluster. The Kyvos SaaS Portal interacts with Kyvos Manager and Kyvos Web Portal to fetch current cluster configurations, cost/usage consumption by the cluster, and the deployment status of the Kyvos cluster.

• Viewing cluster details

• Deploying a new cluster

• Starting a cluster

• Stopping a cluster

• Deleting a cluster

Viewing cluster details

To view cluster details, perform the following steps.

1. On the navigation bar, click Clusters. The Clusters page is displayed.

   • Case 1: For the first time login or when no cluster is created, the following page is displayed.

     Open

     

   • Case 2: After creating clusters, a list will display clusters that have been added using the required subscription.

2. Clicking a cluster will display the following details on the right of the page.

   Open

   

   • Status: Displays a current state of the cluster, such as Offline, Online and Failed.

   • Subscription: Displays a subscription name used to create the cluster. Clicking the subscription name will redirect you to the Subscriptions page and the subscription details will display on the right of the page.

   • Region: Displays the region in which the cluster is deployed.

   • Open Kyvos Manager: Clicking the Open Kyvos Manager link will redirect you to the Kyvos Manager Login page.
     See the Kyvos Manager Management and Monitoring Guide for more details.

   • Open Kyvos Web Portal: Clicking the Open Kyvos Web Portal link will redirect you to the Kyvos Login page.

3. Additionally, you can also view the Overview, Cost Analysis, Audit Logs, and Deployment Details tabs to view further details of the selected cluster.
   From Kyvos SaaS portal 1.7.0, you can now change the compute type from Kyvos Manager on the Compute Cluster page.

   Note: The compute type displayed in the Deployment Details section will remain unchanged when the compute type is modified from Kyvos Manager. Changes to the compute type will be performed by Kyvos Administrators, Kyvos Support personnel, Kyvos DevOps teams, and users who possess administrative rights in Kyvos Manager.

Deploying a new cluster

You can create and deploy a new cluster. After deploying the cluster, the deployment details are displayed.

From Kyvos SaaS portal 1.7.0, you must maintain a minimum balance relative to the clusters being deployed. The minimum balance is calculated as N × $100, where N is the total number of clusters being deployed or already deployed.

To deploy a cluster, perform the following steps.

1. On the navigation bar, click Clusters.

2. Click the New button. The New Cluster dialog is displayed.

3. Select the required Subscription from the list. The current balance of the selected subscription is displayed.

6. Enter the Cluster Name.

7. Enter Description of the cluster if required.

8. Select AWS or Azure from the Cloud Provider list where the cluster needs to be created.

9. Select the geographic location from the Region list where your clusters will be deployed.

10. Select the required deployment type from the Deployment Type list.

    • Single-node deployment: Select this option to run all Kyvos services on a single node. It deploys on existing nodes with bundled Postgres. Disaster recovery and high availability are not supported with single-node deployment.

    • Multi-node deployment: Select this option to run all Kyvos services on separate nodes.

11. Select the Instances Size from the list to specify the capacity of a node that impacts its workload capacity.
    Note:

    • This sizing option is applicable only to BI Server and Query Engine instances.

    • The Web Portal, Kyvos Manager, and Dedicated Compute Cluster instance types remain unchanged.

    • It is applicable to Dedicated Compute, Shared Compute, and Single Node Installer deployments.

    • For AWS

      • Small: m6i.2xlarge

      • Medium: m6i.4xlarge

      • Large: m6i.8xlarge

    • For Azure

      • Small: Standard_D8s_v5

      • Medium: Standard_D16s_v5

      • Large: Standard_D32s_v5

12. Select one of the following options in the Data Processing. This is applicable only when you create a new cluster.

    • Process on Existing Nodes: Select this option to process data on the same nodes as Query Engines and other services. Saves cost, but performance may be limited for heavy workloads.

    • Process on Dedicated Nodes: Select this option to add separate nodes on demand for data processing. Ensures higher performance for large or intensive workloads.
      NOTE: Kyvos does not support Kubernetes (no-Spark) and EMR (Spark-based) deployments.

13. Select the number of Query Engine(s) Instances allocated to the cluster.

14. Enter the IP range in CIDR format for the cluster's services and nodes in the CIDR for Services box.

14. Select the System Availability checkbox.

    1. If this is enabled, two Web Portals, two BI Server nodes, and a minimum of two Query Engines are deployed across multiple availability zones. The Query Engines instances will be auto selected as 2. You can also modify the number of Query Engine instances as needed. The maximum Query Engine can be selected as 5.

    2. If this is disabled, the deployment consists of one Web Portal, one BI Server node, and the specified number of Query Engines—all in a single availability zone to optimize cost. You can specify the number of Query Engines (QEs) between 1 to 5 to be provisioned during deployment based on workload and performance requirements.
       NOTE: With high availability enabled, the system remains operational during availability zone failures.

15. Select the Disaster Recovery checkbox to enable or disable backup and disaster recovery services for the region.

16. In the Login Credentials for Kyvos Manager and Kyvos Web Portal, enter Password.

17. Retype the password to confirm. Ensure that the user name (Admin) and password will remain the same for the Kyvos Manager and Kyvos Web Portal.

    Open

    

18. Click Review and Deploy to create and deploy cluster. The Review and Deploy dialog is displayed.

19. Click Confirm. Once the cluster is deployed, the Kyvos SaaS Portal will give you access to Kyvos Manager and Kyvos Web Portal. User must provide the password setup for cluster to log into these portals.