CHALLENGE

• Migrate and replace a poorly designed cloud data warehouse on Azure that was leveraging VMs to host a Hadoop backup system

• Design a new architecture layer focused around data acquisition, transformation, and ingestion 

• Engineer new data pipelines for multiple source systems

OUTCOME

• In 45 days the client achieved cost savings of $45,000 per month (90% cost reduction)

• Successfully migrated Hadoop, and Oracle DB workloads to Snowflake

• Completed data pipelines for multiple different data sources

• Setup Dev, Test, Prod environments, with Single Sign-on support, role hierarchies, and LDAP user synchronization in Snowflake

• Delivered Snowflake 101 training and enablement

APPROACH

• Discover - Aligned with key stakeholders to review current architecture and define migration requirements

• Design - Established strategies for data architecture, cross-source harmonization, job orchestration, and performance tuning

• Develop - Worked collaboratively with client to develop and implement new data pipelines and ETL processes

• Deliver - Migrated existing ingestion, transformation, and consumption assets from Hadoop to Snowflake

SOLUTION

• Snowflake

• Snowpipe

• Azure

• ADF (Azure Data Factory)

• Kafka

• Hashmap Consulting Services 

  • Snowflake Cloud Data Strategy & Advisory

  • Snowflake Cloud Data Design, Engineering, & Architecture

  • Snowflake Optimization & Management

  • Migration & Modernization