Query Engine YARN Configuration

Applies to: Kyvos Enterprise  Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace

Kyvos Azure Marketplace   Kyvos GCP Marketplace Kyvos Single Node Installation (Kyvos SNI)

This section explains how to configure the Query Engine to run on YARN, including resource allocation, instance settings, and execution parameters in Kyvos Manager.

If the cluster is deployed in YARN mode, Kyvos Manager enables you to configure the YARN services for Query Engines.

Note

From Kyvos 2023.3 onwards, you can see the last operation details, including progress status and start time, by clicking the i  icon.  To view more comprehensive details, simply click the  View Details link, which will take you to the Operations page, where you can view the operation information in detail. 

For this, click the cluster name > Kyvos and Ecosystem > Query Engine (in YARN) on the navigation pane.
Here you can configure YARN-based Query Engines settings such as:

Area

Parameter/Field

Description/Remarks

Area

Parameter/Field

Description/Remarks

Application Master Configuration

YARN Job Name:

Specify a name for the YARN job.

YARN Queue Name

Specify the YARN Queue name.

Application Master Core

Specify the memory configuration for the application master node. 

Application Master Log Path

Specify the path for generating Application Master logs for the YARN cluster. 

Application Master Schedule

Restart Application Master

Specify the schedule for restarting the application master.

Query Engine YARN Configuration

Operation Mode

Select Count Based or Host Based option.

Nodes

If you have selected the Host Based option, specify the Host Name and Instance Count for the nodes. 

Query Engine Instance Count

If you have selected the Count Based option, specify the number of Query Engine instances to be launched. 

Container Core

Enter the number of virtual cores to be used by Kyvos Query Engine and specify the memory for each core.

Log Path

Enter the path for saving Query Engine logs. Ensure that the path exists on data nodes and the user (with which YARN containers are launched) has write permissions on this path

Log Sync Schedule

Enter the time interval for syncing Query Engine logs on HDFS.

Query Engine Schedule

Enable Schedule

Select this check box to enable the scheduling of Query Engines.

Additional Query Engine Nodes

Enter additional minimum Query Engine hostnames (if any) and the corresponding instance count. This is displayed only when Scheduling of Query Engines is enabled

Select Query Engines to Exclude from Schedule

If you want to exclude any Query Engines from the schedule, select them from the list here.

Copyright Kyvos, Inc. 2026. All rights reserved.