Kyvos on AWS

Applies to: Kyvos Enterprise Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace

Kyvos Azure Marketplace Kyvos GCP Marketplace Kyvos Single Node Installation (Kyvos SNI)

Kyvos on AWS with No-Spark

No-Spark Architecture on AWS is designed for high-performance, scalable analytics, delivering results without relying on traditional Spark-based processing. At the foundation are diverse data sources, including Apache Iceberg, Parquet, CSV files, Amazon S3, Amazon Redshift, and Snowflake, which serve as input for Kyvos’ elastic infrastructure.

The Elastic Processing Cluster, deployed using AWS Auto Scaling Groups (ASG) or Elastic Kubernetes Service (EKS), is responsible for scalable and on-demand data ingestion and semantic model processing. In parallel, the Elastic Querying Cluster, running on Amazon EC2, handles interactive query execution using both raw and pre-aggregated data stored in the Kyvos Data Storage layer—typically residing in Amazon S3.

An Analytical Server, also hosted on EC2, manages orchestration across components, including data modeling, job scheduling, and governance. Central to the architecture is the Semantic Layer, which enables business users to perform self-service analytics through curated and business-aligned data models. The platform supports multiple query languages such as SQL, MDX, DAX, and integrates APIs including REST and Java for extended programmability.

Furthermore, Kyvos offers seamless compatibility with industry-leading BI tools such as Tableau, Power BI, Looker, Microsoft Excel, and Strategy, along with native capabilities provided by Dialogs, Kyvos Viz (powered by AI), Kyvos Excel Add-in, and Kyvos Reporting. To ensure optimal performance, the data store intelligently caches frequently accessed query patterns, thereby delivering sub-second response times.

This cloud-native architecture is designed for cost efficiency, high concurrency, and exceptional performance at scale, while also incorporating AI features for advanced analytical capabilities.

Kyvos on AWS with Spark

Kyvos' cloud-native architecture is designed for cost-effective analytics with speed at scale. With built-in elasticity, the Kyvos BI Servers and Query Engines can scale up and down seamlessly to balance loads, ensure optimal utilization of resources, and deliver on SLAs. The separation of storage (Smart Aggregates) and compute (Query and Compute Engine) ensures enterprise governance and no data movement.

Kyvos is a cloud-native semantic layer deployed directly on AWS (Amazon Web Services) that consists of two main components: BI Servers and Query Engines (QE). The Kyvos BI server is deployed on a standalone Elastic Compute Cloud (EC2) instance. Query engines are also deployed on standalone EC2 instances. They can be configured to increase or decrease depending on the load.

Once the semantic models are processed, they are stored in S3 for persistent storage. To achieve high performance, Kyvos replicates the cuboids and their metadata on shared storage using the local disks of the query engines. This helps deliver higher performance as compared to querying semantic models directly on S3.

The auto-scaling feature of EMR (Elastic Map Reduce) enables Kyvos to scale up and down on AWS at the time of semantic model processing using the Amazon EMR service.

Kyvos reads data from S3 and processes it using the EMR cluster. It launches a series of MapReduce or Spark jobs for semantic model processing.
At the time of Kyvos deployment, EMR is configured such that the cluster can scale in or scale out to use only the resources that are needed.
This ensures that only the required number of machines are running in the on-demand EMR cluster during the semantic model process.

Kyvos supports querying elasticity through scheduled and load-based scaling. Based on the expected loads, you can specify the day/time when resources need to scale up or down. This helps reduce costs during lean periods.

Highlights

Elastic semantic model processing using EMR/Databricks
Leverages S3/ Delta Lake for semantic model storage
High-performance, elastic querying
No need to move data out of your storage platform

Kyvos' modern architecture enables deep integration with AWS, as shown here.

Related topics