Business Challenges
- Consolidated view of data from finance industry leaders.
- Lack of cutting-edge Analytics on the transactional data.
- Lack of Slicing and Dicing of Risk Management complex KPI’s across various dimensions.
- Need to make BI self Service across the organization.
- Need to create a client-centric reporting framework.
Engagements
One of the top BSFI software products and services providers of the Global were working towards improving their Data warehouse and wanted to self-services an analytical web portal for their merchants.
Data warehouse(PostgreSQL), Talend as ETL tool and Data Analytics (Python and Django)
The Solution
Approach & Solution
- Migrated different types of data from different sources/formats by using Talend Studio as an ETL tool and loaded the data into the warehouse created in a new server.
- Used Spark with python, Kafka to load data Realtime data
- Used python to build data analytic models.
- Used Django framework to build self-service analytics
Benefits & Outcome
- Reduced Data storage
- Increased Data Availability.
- Self service analytics
- Used open sources to build analytics and portal
Tools
- EDB PostgreSQL
- Python
- Spark with Python, Kafka
- Django with microservices architecture