Bring data in
Collect files and data from the sources your business uses, without relying on someone to manually collect, copy and move them.
Azure data pipelines
Automate data processes specific to your business
Service · Azure data pipelines
Automate the data processes specific to your business
FundSolve and WealthSolve are built for specific fund and wealth data. When you need to process other data, we build Azure-native pipelines to ingest, validate, transform and deliver it.
How it works
- 01
- 02
Validate and process it
Apply validation, mapping, business rules and transformations as part of the pipeline rather than leaving them buried in spreadsheets or manual processes.
- 03
Deliver it where it's needed
Send processed data to your databases, applications, reporting tools or other systems that need it.
For investment businesses that need a reliable way to ingest, validate and process data beyond FundSolve and WealthSolve. Pipelines are built in your Azure subscription and managed by Ocellics.
THE PIPELINE
What a typical pipeline looks like
Most of the pipelines we build follow a similar pattern, using Azure services and our own specialist processing logic to validate, map and transform your data into governed, usable data.
Logic Apps connect to sources and trigger the pipeline. Data Factory orchestrates the pipeline and processes the data, including Ocellics-built rules, mappings and transformations, and Synapse handles larger or more demanding transformation workloads. Blob Storage and Azure SQL hold data throughout the process. Power BI and APIs put the data to use.
Fetch
Bring the data in
Logic Apps
Connect to sources and trigger the pipeline.
Ingest and process
Validate, map and transform
Data Factory
Orchestrate the pipeline and process the data.
In Data Factory
Custom logic
Ocellics-built rules, mappings and transformations.
Synapse
Handle larger or more demanding transformation workloads.
Deliver
Put the data to use
Power BI
Reporting and visualisation.
APIs
Make data available to other systems.
Store
Hold data throughout the process
Blob Storage
Files and data used throughout the pipeline.
Azure SQL
Structured data ready for use.
Integration
Built around the systems you already use
Azure data pipelines can work independently, connect with your existing systems, or use governed data from FundSolve and WealthSolve as part of a wider process.
Independent pipelines
Process business, accounting, client or other data without involving an Ocellics product.
Existing systems
Connect with the databases, applications and reporting tools already used across your business.
Ocellics data
Use governed data from FundSolve or WealthSolve where it forms part of a wider process, without changing the data each product is designed to manage.
Use cases
Where Azure data pipelines fit
Recurring files and feeds
Automate files and datasets that arrive regularly and still need someone to collect, check or prepare them.
Accounting and finance data
Bring accounting and finance data into a repeatable process for reconciliation, reporting or use by other systems.
Client and business data
Process data used by internal applications, client reporting and operational processes.
Moving data between systems
Replace manual exports, imports and hand-offs between databases, applications and reporting tools.
Large or complex datasets
Handle data that has outgrown spreadsheets or requires significant validation, transformation or processing.
Processes specific to your business
Build a repeatable pipeline around a data process that is particular to the way your business operates.
Related offerings
How this sits with the rest of Ocellics
FundSolve
FundSolve handles the fund data it is designed to manage.
WealthSolve
WealthSolve handles the wealth data it is designed to manage.
Azure data pipelines
Handles other data and custom processing requirements outside the defined scope of those products. It may consume data from FundSolve or WealthSolve where required.
Fund-data engineering
Use Fund-data engineering where the requirement goes beyond data movement and processing into custom applications, integrations or broader software development.
Managed Azure
Where required, Ocellics can also host and manage the Azure infrastructure used by the pipeline.
Have a data process that's still too manual?
If your business has files or data that need to be collected, checked, transformed and delivered repeatedly, we can look at whether an Azure pipeline is the right way to automate it.