HASHMAP SOLUTION PROFILE

INDEPENDENT UPSTREAM OIL & GAS

Modernizing and Migrating a Traditional Hadoop Data & Analytics Platform to the Cloud in AWS 

CHALLENGE

  • Quicker insight to action

  • Reduce ongoing operational effort and costs associated with existing data warehousing solutions

  • Enable ingest and management of a wide variety of structured and semi-structured datasets

  • Avoid significant capital cost outlays

APPROACH

  • Migration of numerous existing data applications from a traditional Hadoop Big Data platform to Snowflake including SCADA, Financial, Energy Information, and Weather data

  • Refactoring of the applications to use AWS S3, Snowflake Snowpipe, and VSTS

  • Scheduling performed with an existing Control M environment

OUTCOME

  • Rapid deployment, configuration, and build out of a cloud data warehouse for a variety of data sources

  • Enforcement of data governance practices through DevOps pipelines

  • Completed testing of data replication solutions into Snowflake

SOLUTION

  • Snowflake 

  • Databricks 

  • AWS

  • dbt

  • Attunity

  • Hashmap Consulting Services: Cloud Data Migration, DW Engineering, Data Pipelining, DevOps

Connect Now >