Grab Engineering - Data Mesh in Grab

Here is some notes for Grab Engineering - Data Mesh in Grab.

Ref:

1. Part 1

1.1. Problem Statement

  • Big Data of Grab in the furure.

  • Data mesh: ownership and understand data.

1.2. Certificate

  • Ownership: who own this data.

  • Data contract: between producer and consumer.

1.3. Operation

  • P80 datasets (the top 80% of Grab’s most used data)

2. Part 2

2.1. Hubble (Ingestion + Verification + Visualization Data)

  • State Machine: for data verification

2.2. Genchi - Manual Integration Testing Tool

  • Example:

  • Architecture:

2.3. Data Contract Registry - The producer–consumer agreement layer

{
  "specification_version": 1,
  "asset_urn": "urn:li:dataset:(urn:li:dataPlatform:hive,genchi.validation_jobs,PROD)",
  "entity_type": "datalake_table",
  "health_url": "https://example-hugo.grab.com/assets/genchi.validation_jobs/health",
  "contract_details": {
    "contact": {
      "oncall_group": "oncall-genchi",
      "slack_channel": "ask-genchi"
    },
    "terms": {
      "usage": "Source of truth for all genchi validation jobs.",
      "limitations": "Not suitable for real-time use cases.",
      "notice_period_in_days": 14
    },
    "schema": [
      {
        "type": "genchi",
        "health_url": "https://example-genchi.grab.com/assets/genchi.validation_jobs/tests/fundamental_schema_test/health",
        "uid": "fundamental_schema_test",
        "version": 1
      }

    ],
    "sla": {
      "freshness": [
        {
          "type": "genchi",
          "health_url": "https://example-genchi.grab.com/assets/genchi.validation_jobs/tests/fundamental_freshness_test/health",
          "uid": "fundamental_freshness_test",
          "version": 1
        }
      ],
      "lifecycle": null
    },
    "data_quality": [
      {
        "type": "genchi",
        "health_url": "https://example-genchi.grab.com/assets/genchi.validation_jobs/tests/fundamental_completeness_test/health",
        "uid": "fundamental_completeness_test",
        "version": 1
      }
    ]
  }
}

2.4. Overall System

3. Part 3

3.1. Data Production Issues (DPIs)

  • Notification and assign owner when bug about data.
August 30, 2026