HASHMAP SOLUTION PROFILE
INDEPENDENT UPSTREAM OIL & GAS
Modernizing and Migrating a Traditional Hadoop Data & Analytics Platform to the Cloud in AWS
CHALLENGE
-
Quicker insight to action
-
Reduce ongoing operational effort and costs associated with existing data warehousing solutions
-
Enable ingest and management of a wide variety of structured and semi-structured datasets
-
Avoid significant capital cost outlays
APPROACH
-
Migration of numerous existing data applications from a traditional Hadoop Big Data platform to Snowflake including SCADA, Financial, Energy Information, and Weather data
-
Refactoring of the applications to use AWS S3, Snowflake Snowpipe, and VSTS
-
Scheduling performed with an existing Control M environment
OUTCOME
-
Rapid deployment, configuration, and build out of a cloud data warehouse for a variety of data sources
-
Enforcement of data governance practices through DevOps pipelines
-
Completed testing of data replication solutions into Snowflake
SOLUTION
-
Snowflake
-
Databricks
-
AWS
-
dbt
-
Attunity
-
Hashmap Consulting Services: Cloud Data Migration, DW Engineering, Data Pipelining, DevOps