shutterstock_1734559556.jpg

HASHMAP SOLUTION PROFILE

INTERNATIONAL OIL FIELD SERVICES

Modernized Data Flow Pipeline Enabling ML Insights in Azure

CHALLENGE
  • Build a universal platform with complete data governance and appropriate multi-tenant data isolation, supported on Azure Stack

  • Enabling different publishers and consumers to use the platform as data storage and source for their data pipelines

OUTCOME
  • Delivered a modern cloud based framework 

  • Cloud based Azure storage accounts with Rest APIs enabling users to easily publish their data

  • Event based data data flow developed using Azure resources and triggering a Dataiku workflow to train a learning model

APPROACH
  • Workshops across various domains to understand the complete platform requirements

  • High level design of the proposed architecture

  • Detailed low level design 

  • Agile methodology for the complete project using Azure DevOps

  • CI/CD using Azure DevOps

SOLUTION
  • Azure Data Factory

  • Apache NiFi on AKS (for Azure Stack)

  • Dataiku

  • Azure Event Hub

  • Azure Functions

  • Azure Blob Storage, Tables, SQL DB

  • Azure App Insights

  • Elasticsearch, Kibana, and FluentD on Azure Kubernetes

  • Azure AD, Key Vault, Managed Identity

  • Hashmap Consulting Services including Data & Cloud Strategy & Modernization, Solution & Tech Guidance, Cloud Optimization and Management, Cloud Automation

HashmapLogoBlack_edited.png
  • Hashmap on LinkedIn
  • Tweet Hashmap
  • Hashmap on Facebook
  • Hashmap Stories
  • Data Rebels on Tap on Spotify
  • Hashmap on YouTube
  • Hashmap on Instagram

© 2020 by Hashmap, Inc.