HASHMAP SOLUTION PROFILE

INTERNATIONAL OIL FIELD SERVICES

Modernized Data Flow Pipeline Enabling ML Insights in Azure

CHALLENGE

  • Build a universal platform with complete data governance and appropriate multi-tenant data isolation, supported on Azure Stack

  • Enabling different publishers and consumers to use the platform as data storage and source for their data pipelines

OUTCOME

  • Delivered a modern cloud based framework 

  • Cloud based Azure storage accounts with Rest APIs enabling users to easily publish their data

  • Event based data data flow developed using Azure resources and triggering a Dataiku workflow to train a learning model

APPROACH

  • Workshops across various domains to understand the complete platform requirements

  • High level design of the proposed architecture

  • Detailed low level design 

  • Agile methodology for the complete project using Azure DevOps

  • CI/CD using Azure DevOps

SOLUTION

  • Azure Data Factory

  • Apache NiFi on AKS (for Azure Stack)

  • Dataiku

  • Azure Event Hub

  • Azure Functions

  • Azure Blob Storage, Tables, SQL DB

  • Azure App Insights

  • Elasticsearch, Kibana, and FluentD on Azure Kubernetes

  • Azure AD, Key Vault, Managed Identity

  • Hashmap Consulting Services including Data & Cloud Strategy & Modernization, Solution & Tech Guidance, Cloud Optimization and Management, Cloud Automation

Connect Now >