Summit K12

Enterprise Scale, Cloud Based Learning Management System

2008 - Austin,TX

E- learning providers

51-200 employees

Overview

Summit K12, a US-based academic institution partnered with Folio3 to facilitate development of a digital solution to revolutionize its data processing capabilities, and scale exponentially through a data-driven approach. This problem was addressed by implementing an advanced Big Data Analytics platform, leveraging Cloud infrastructure for seamless scalability and cost-effective operations.

The Challenge

Processing Massive Data Volumes

Traditional data processing methods reached their limits as Summit K12’s data volumes grew exponentially, necessitating a shift to a more scalable solution.

The existing infrastructure struggled to cope with the ever-increasing demands of processing and analyzing vast amounts of heterogeneous data.

Embracing a CI/CD culture across the implementation teams to streamline and automate deployments while ensuring minimal downtime.

The Solution - Real-time Big Data Processing & Analytics

Folio3 conducted a comprehensive assessment of Summit K12’s infrastructure, identifying the need for modernization and optimization.

Based on this evaluation, Folio3 proposed a Cloud-based solution using AWS infrastructure, harnessing services like Amazon Elastic MapReduce (EMR) to effortlessly scale big data workloads.

Apache Spark

Enabled fast, in-memory data processing and analytics, optimizing computation speed and resource utilization.

Apache Glue

Automated data discovery, cataloging, and transformation, simplifying ETL processes and facilitating seamless data integration.

Apache Iceberg

Streamlines management of large-scale educational datasets in the data lake, ensuring efficient querying and evolution tracking.

Amazon Redshift

Database migration, offering high-performance, scalable, and cost-effective data warehousing solutions.

Amazon S3

Provides scalable and durable storage for educational data, ensuring secure and reliable access to resources.

zero ETL

Additionally, zero ETL was also used with Amazon RedShift and Amazon S3 to analyze and process large volumes of raw educational data.

AWS Database
Migration Service

Simplifies migration of educational databases to AWS with minimal disruption and data integrity preservation.

Amazon Kinesis

Used in real-time ingestion, processing and streaming of educational data for dynamic analytics and insights generation.

AWS CloudFormation

Utilization of AWS CloudFormation for Infrastructure as Code (IaC), ensuring consistent and reproducible deployments.

Automation of
infrastructure

Automation of infrastructure changes using AWS CloudFormation, reducing the need for manual intervention.

Testing &
Deployment

Integration of Jenkins for CI/CD pipelines, enabling automated testing and deployment processes.

Real Time Data
Analytics

Kinesis streams for real time data analytics

In addition to the above, the Folio3 team also built a number of advanced dashboards and reports, designed in a way where they could be viewed from many different angles through a diverse range of filters. This was a highly optimized process where report speeds were reduced from minutes to milliseconds, including leaderboards updated daily.

Technologies Used

Milestones & Achievements

Processing Terabytes of Data Daily

Folio3's robust infrastructure management facilitated the processing of millions of records of data on a daily basis.

10+ 3rd Party
Integrations

Summit K12 achieved integration with numerous external data sources such as, enhancing its analytics capabilities.

Significant Cost Savings

Substantial cost savings 30% for Summit K12 through efficient infrastructure design, optimizing their operational expenses while scaling their analytics capabilities.