
HASHMAP SOLUTION PROFILE
NORTH AMERICAN
TELECOMMUNICATIONS PROVIDER
Reducing Costs by 90% with Snowflake by Migrating off of Hadoop
CHALLENGE
-
Migrate and replace a poorly designed cloud data warehouse on Azure that was leveraging VMs to host a Hadoop backup system
-
Design a new architecture layer focused around data acquisition, transformation, and ingestion
-
Engineer new data pipelines for multiple source systems
OUTCOME
-
In 45 days the client achieved cost savings of $45,000 per month (90% cost reduction)
-
Successfully migrated Hadoop, and Oracle DB workloads to Snowflake
-
Completed data pipelines for multiple different data sources
-
Setup Dev, Test, Prod environments, with Single Sign-on support, role hierarchies, and LDAP user synchronization in Snowflake
-
Delivered Snowflake 101 training and enablement
APPROACH
-
Discover - Aligned with key stakeholders to review current architecture and define migration requirements
-
Design - Established strategies for data architecture, cross-source harmonization, job orchestration, and performance tuning
-
Develop - Worked collaboratively with client to develop and implement new data pipelines and ETL processes
-
Deliver - Migrated existing ingestion, transformation, and consumption assets from Hadoop to Snowflake
SOLUTION
-
Snowflake
-
Snowpipe
-
Azure
-
ADF (Azure Data Factory)
-
Kafka
-
Hashmap Consulting Services
-
Snowflake Cloud Data Strategy & Advisory
-
Snowflake Cloud Data Design, Engineering, & Architecture
-
Snowflake Optimization & Management
-
Migration & Modernization
-