Modernization of a global investment intelligence platform featured by The Wall Street Journal
A provider of investment decision-support tools serving 82 of the top 100 banks worldwide engaged AgileEngine to accelerate a multi-year modernization initiative. Our team provided data engineering, backend development, and DevOps expertise across several strategic verticals, helping modernize cloud infrastructure, optimize data distribution, automate business workflows, and improve platform performance.
Industries
Fintech, Financial services, Asset management, ESG
Services
Backend development, DevOps, Cloud architecture, Modernization, Data engineering
Solutions
Cloud, CI/CD, Data pipeline, System optimization, Data lakehouse, Workflow automation, Data migration, Authentication and authorization, Audit logging
Technologies
Python, Snowflake SQL, FastAPI, Pandas, PySpark, Trino, Azure Kubernetes Service (AKS), Azure DevOps, Apache Airflow, Helm, Azure Key Vault
AI tools that powered our workflow
Copilot, Cursor, ChatGPT
Outcomes
and highlights
- 75–80% faster query execution, reducing response times from 18–20 seconds to 3–4 seconds
- 75% reduction in execution latency for data retrieval achieved for the ESG (environmental, social, and governance) ratings model
- 100% automated ESG rating presentation workflow, significantly reducing manual effort for client consultation calls
“AgileEngine has exceeded expectations, showing a fast ramp-up period and taking full ownership of a service built from scratch. They’ve successfully managed the complexities of a large organization by independently connecting with the right stakeholders. They’ve also shown strong initiative, taking on tasks that weren’t assigned to them just to help out a new teammate.”
– VP of Engineering
Solutions overview
Building the foundation for investment data platforms
The client’s platform covers extensive datasets representing trillions in cumulative investments, with over seven billion positions processed daily. AgileEngine worked on the core solutions enabling high-stakes financial analytics, while also impacting Energy Transition metrics, Corporate Sustainability Insights (CSI), and Sustainable Finance Disclosure Regulation (SFDR) compliance.
Our team modernized legacy data distribution by migrating it to a cloud-native environment, transforming research notebooks into production-ready Lakehouse pipelines, and automating workflow orchestration. Alongside these data engineering efforts, we developed the secure backend foundation for a client-facing presentation platform.
Key deliverables
- Cloud-native data distribution architecture replacing legacy delivery workflows, including migration from Capture Platform to OMDP
- Production-ready Lakehouse pipelines built from research notebooks
- Secure backend architecture for client-facing presentation tools
- Automated workflow orchestration using Apache Airflow
- Framework for user authentication and authorization, with activity tracking to support application security and audit trails
- Automated ESG presentation workflow
Technologies
Python, FastAPI, Pandas, PySpark, Snowflake SQL, Apache Airflow
Improving platform performance through cloud infrastructure optimization
AgileEngine improved the performance, efficiency, and scalability of the client’s ESG analytics platform by addressing database bottlenecks and modernizing the underlying infrastructure. The team optimized query execution logic, reducing data retrieval times from 18–20 seconds to 3–4 seconds — a 75% improvement in application responsiveness.
Our experts also helped transition the platform from a Databricks SQL Warehouse environment to a customized Trino architecture running on Azure Kubernetes Service (AKS). The modernization introduced a more flexible infrastructure foundation, improving query performance, deployment reliability, and long-term maintainability.
Key deliverables
- V1 production release of a customized Trino architecture on AKS
- CI/CD deployment pipelines built with Azure DevOps
- Database query optimization reducing execution latency by 75%
- Faster data retrieval workflows improving ESG platform responsiveness
- Infrastructure automation workflows using Helm and Azure Key Vault
- Standardized repository governance supporting maintainable development workflows
Technologies
Azure Kubernetes Service (AKS), Trino, Azure DevOps, Helm, Azure Key Vault
See more success stories
We turn bold ideas into pixel-perfect, scalable, and smooth digital products. Partner with our world-class engineers, AI specialists, and UX designers to boost your engineering ROI and product outcomes.