Skip to main content

Transformations

Transformations can be added in a Flow to transform data from a source as you ingest it into a Onehouse table.

No-code transformations​

Onehouse offers several no-code transformations that you can easily add into your Flows:

  • Add Current Timestamp - Adds a new field with the timestamp of when the transformation is run
  • Add Derived Date - Converts an existing date field to a string with a custom format
  • Convert CDC Data - Processes CDC data from operational databases to update records based on insert/update/delete operations
  • Explode Array - Converts each element from an array into a new row
  • Filter Rows - Filters rows that match specified conditions using various operators
  • Flatten Struct - Converts struct properties into top-level fields with concatenated names
  • Generate Vector Embeddings - Creates vector embeddings from text data using OpenAI or VoyageAI models
  • Mask Data - Masks sensitive data by hashing or truncating fields for privacy

Custom transformations​

Custom transformations allow you to inject custom Java code into your Flows. Follow these instructions to create a custom transformation.