pexels-photomix-company-95719_edited.jpg

HASHMAP SOLUTION PROFILE

NORTH AMERICAN
TELECOMMUNICATIONS PROVIDER

Reducing Costs by 90% with Snowflake by Migrating off of Hadoop

CHALLENGE
  • Migrate and replace a poorly designed cloud data warehouse on Azure that was leveraging VMs to host a Hadoop backup system

  • Design a new architecture layer focused around data acquisition, transformation, and ingestion 

  • Engineer new data pipelines for multiple source systems

OUTCOME
  • In 45 days the client achieved cost savings of $45,000 per month (90% cost reduction)

  • Successfully migrated Hadoop, and Oracle DB workloads to Snowflake

  • Completed data pipelines for multiple different data sources

  • Setup Dev, Test, Prod environments, with Single Sign-on support, role hierarchies, and LDAP user synchronization in Snowflake

  • Delivered Snowflake 101 training and enablement

APPROACH
  • Discover - Aligned with key stakeholders to review current architecture and define migration requirements

  • Design - Established strategies for data architecture, cross-source harmonization, job orchestration, and performance tuning

  • Develop - Worked collaboratively with client to develop and implement new data pipelines and ETL processes

  • Deliver - Migrated existing ingestion, transformation, and consumption assets from Hadoop to Snowflake

SOLUTION
  • Snowflake

  • Snowpipe

  • Azure

  • ADF (Azure Data Factory)

  • Kafka

  • Hashmap Consulting Services 

    • Snowflake Cloud Data Strategy & Advisory

    • Snowflake Cloud Data Design, Engineering, & Architecture

    • Snowflake Optimization & Management

    • Migration & Modernization