HASHMAP SOLUTION PROFILE
INTERNATIONAL OIL FIELD SERVICES
Modernized Data Flow Pipeline Enabling ML Insights in Azure
CHALLENGE
-
Build a universal platform with complete data governance and appropriate multi-tenant data isolation, supported on Azure Stack
-
Enabling different publishers and consumers to use the platform as data storage and source for their data pipelines
OUTCOME
-
Delivered a modern cloud based framework
-
Cloud based Azure storage accounts with Rest APIs enabling users to easily publish their data
-
Event based data data flow developed using Azure resources and triggering a Dataiku workflow to train a learning model
APPROACH
-
Workshops across various domains to understand the complete platform requirements
-
High level design of the proposed architecture
-
Detailed low level design
-
Agile methodology for the complete project using Azure DevOps
-
CI/CD using Azure DevOps
SOLUTION
-
Azure Data Factory
-
Apache NiFi on AKS (for Azure Stack)
-
Dataiku
-
Azure Event Hub
-
Azure Functions
-
Azure Blob Storage, Tables, SQL DB
-
Azure App Insights
-
Elasticsearch, Kibana, and FluentD on Azure Kubernetes
-
Azure AD, Key Vault, Managed Identity
-
Hashmap Consulting Services including Data & Cloud Strategy & Modernization, Solution & Tech Guidance, Cloud Optimization and Management, Cloud Automation