Data-warehouse Architecture, Design & Implementation

Data-warehouse Architecture, Design & Implementation

Michael O

DataEngineer and Datawarehouse Architect

30 days
Create a Free Account


Why a Datawarehouse? Data-warehouses are the centre of the modern data set up. It allows the reconciliation of different data sources. As a company grows and the need for data increases. Differences appear from data source to data source. eg Google Analytics (event tracking) and Marketing data fails to align with backend or CRM data (Salesforce, Mail-chimp, Hubspot etc). Without a Datawarehouse (or a correctly organised one) a number of problems arise for companies - Data is spread across Spreadsheets (Excel, google Sheets): theses are increasingly difficult to maintain and debug - Numbers change historically - Departments disagree about the source of truth and the definition of KPIs - Data quality issues go unnoticed or are hard to track down - Building reports is slow and labour intensive My Motivation I believe in there being one reconcilable truth, and that using this knowledge is the best way to move forward for any company. A correctly functioning Data-warehouse is the best way to reach this truth and transparency. I specialise in designing or repairing data-warehouse solutions as well as training the Analytics or BI to be more effective at their job moving forward. Data-warehousing is typically an expensive project with a high risk of project failure. With modern technology and my approach this risk and cost can be reduced. Outputs - Datawarehouse set up: AWS Redshift, BigQuery, Snowflake, Postgres (not recommend) - Data imported from core data sources: -- Production Databases -- CRM systems: Salesforce etc -- Call Systems: New Voice Media etc -- Marketing Platforms: Google Ads, Criteo, Facebook etc -- GSheets -- Event and Product Data: Snowplow, Google Analytics etc - Data Modelling according to Kimball Method -- In SQL Modeling layer -- Core Fact & Dims tables - Transformation and Cleaning of Raw data -- Business Logic applied -- Data reconciliation -- Data quality control -- Data quality testing - Training and Upskilling -- Training regarding best practices for inhouse BI Analysts or Engineers -- Assistance in hiring as required - Budget control and Prioritisation Planning -- Choosing the best products and the correct scale point for businesses -- Suggesting and implementing bespoke in-house implementations where appropriate - Demo Dashboards as required Timeline - 1.5 to 6months depending on company size and desired scope -- example: Company starting fresh Datawarehouse for marketing purposes with a gross revenue of less than €2million per month, (or Marketing spend less than €4million per month) seeking initial design and 1 core fact table = 1.5months Example Downstream Value Adds from improved Datawarehouse - Correct data across the company - Improved Marketing spend (ROI) - In-house Multitouch attribution - Improved Customer lifetime value and cohort analysis - Allows Datascience (data-science performed before a functioning datawarehouse is ineffective and often flawed) - Product Feeds - Providing Data as a product to end customers


Data-warehouse Choice and Setup (Redshift, BigQuery, Snowflake)

Extract & Loading of Raw data into Data-warehouse

Modelling of Core business Dims and Facts Tables

Frequently Asked Questions

Which services can clients contract via the MeasureMatch marketplace platform?

The consultants, consultancies, agencies & SIs in our global network execute important systems and data project work including, but not limited to:

-            Select and deploy a data warehouse solutions like Snowflake, BigQuery and others

-            Set up dashboards in Power BI, Tableau or Google Data Studio

-            Power customer data collection using RudderStack, Segment, Tealium or similar

-            Implement product analytics solutions like Mixpanel or Amplitude

-            Build data pipelines in Azure, AWS and Google Cloud

-            Transform data using dbt, Fivetran and similar

-            Plus heaps of data & analytics services reaching into complex AI/ML initiatives

The MeasureMatch global network of professionals is highly skilled, many are certified service providers with proficiencies across more than 3,000+ tools and products including the Adobe Experience Cloud stack, the Google Marketing Platform and Google Cloud suite of tools, Segment, Mixpanel, Intercom, Hubspot, DOMO, Power BI, Tableau and 1,000s more.

Why book consultants or consultancies via MeasureMatch?

It's easy and incredibly fast to find and book an incredibly valuable professional services partners through the MeasureMatch marketplace platform.

And, because we handpick and screen all service provider applicants, or they are invited by technology vendors participating in the MeasureMatch Partner Exchange, we're seeing more than 95% of contracts rated 5 full starts by clients (as of September 2023).

Whether it's Salesforce, Microsoft Dynamics, HubSpot, Intercom or Freshsales skills you need - to name a few in one of our most popular services categories (CRM & Marketing Automation), MeasureMatch has the skills and pros you need.

3,000+ skills across 10,000+ systems & data services professionals are accessible via the MeasureMatch marketplace and partnerships platform.

You'll have direct, seamless and flexible access to a highly-skilled, verified workforce of independent consultants, consultancies, agencies and even system integrators, each armed with the skills to advance customer and product data collection, data engineering, data pipeline management, marketing analytics, marketing automation, personalization, programmatic media investment management and much more.

Who should sign up to MeasureMatch?

On one side, through a Client account, the platform is for business leaders who need to solve for, address and advance any number of cloud software systems and/or data challenges, and they are open to embracing service providers located anywhere across the globe to get the work done.

On another side, with a Service Provider account, MeasureMatch is for consultancies, agencies, system integrators and independent consultants to provide exceptional systems & data professional services.

The third entry point into MeasureMatch, the Partner Exchange, is for SaaS and enterprise software vendors, and a growing number of other types of organizations, to use a set of tools grow and deepen service provider relationships for customer success, go-to-market partnerships, and more.

Does MeasureMatch quality control new service providers?

Every one of the MeasureMatch network of service providers has been through a stringent application process, including an interview to ensure relevance of Service providers and quality of delivery. And each is fully aware of the how the platform works, including the commercial framework.

What are MeasureMatch Service Packages?

A Service Package describes a service on offer from a consultant or consultancy participating in the MeasureMatch professional services marketplace.
Service Packages compliment MeasureMatch Experts' profiles with services that can be booked "off the shelf".
Service Packages are the only way a prospective client can directly strike up a discovery, scoping, pricing negotiation with any MeasureMatch Expert - otherwise, a project brief needs to be submitted.
Get Started Free