Parse JSON
Parse JSON converts JSON-encoded string fields into structured columns, enabling extraction of nested data from source fields that contain serialized JSON.
When to Use
Use Parse JSON when:
- Your source contains string fields with embedded JSON data (e.g., a
payloadcolumn containing a JSON string). - You want to extract structured fields from JSON strings so they can be queried, filtered, and partitioned.
- You need to convert unstructured or semi-structured JSON data into a typed schema.
Configuration
When adding a Parse JSON transformation to a Flow:
- Select Parse JSON from the list of available transformations.
- Specify the source field containing the JSON string.
- The transformation parses the JSON and expands the resulting fields into the destination schema.
Usage Notes
- The JSON string must be valid JSON. Malformed JSON records may be routed to the quarantine table if quarantine is enabled.
- Nested JSON structures are expanded into structured columns based on the inferred schema.
- This transformation is useful when ingesting data from sources that serialize payloads as JSON strings (e.g., Kafka message values stored as raw JSON text within a wrapping schema).