oh job
Manage and run JAR and Python Spark jobs.
Job types: JAR PYTHON
oh job show
Lists all jobs.
oh job show
oh job describe NAME
Describes a job.
oh job describe etl-transform
oh job create NAME
Creates a job definition without running it.
| Flag | Required | Description |
|---|---|---|
--type | Yes | JAR or PYTHON |
--cluster | Yes | Cluster to run the job on |
--parameters PARAM | No | Parameters passed to the job; repeatable. For JAR jobs these are positional args. For PYTHON jobs the first parameter is the script path. |
oh job create etl-transform \
--type JAR \
--cluster prod \
--parameters --input-table=events.clicks \
--parameters --output-table=events.clicks_enriched
oh job create-and-run NAME
Creates a job definition and immediately submits a run. Accepts the same flags as job create.
oh job create-and-run etl-transform \
--type JAR \
--cluster prod \
--parameters --input-table=events.clicks
oh job alter NAME
Alters a job. Provide exactly one of --cluster or --parameters — not both.
| Flag | Description |
|---|---|
--cluster | New cluster (exclusive with --parameters) |
--parameters PARAM | New parameter list; repeatable (exclusive with --cluster) |
oh job alter etl-transform --cluster prod-v2
oh job run NAME
Runs a previously created job.
oh job run etl-transform
oh job show-runs NAME
Lists all runs for a job.
oh job show-runs etl-transform
oh job describe-run JOB_RUN_ID
Describes a specific job run by its UUID.
| Flag | Required | Description |
|---|---|---|
--job-name | Yes | Name of the parent job |
oh job describe-run 4a7f38dc-... --job-name etl-transform
oh job cancel-run JOB_RUN_ID
Cancels an in-progress job run.
| Flag | Required | Description |
|---|---|---|
--job-name | Yes | Name of the parent job |
oh job cancel-run 4a7f38dc-... --job-name etl-transform
oh job upload-jar NAME
Uploads a JAR file to be used in custom transformations or JAR jobs.
Flags
| Flag | Required | Description |
|---|---|---|
--options KEY=VALUE | Yes | WITH clause parameters; repeatable (see Special parameters) |
Special parameters
| Parameter | Description |
|---|---|
s3.path | Path to the JAR file in S3. Use for AWS projects. |
gcs.path | Path to the JAR file in GCS. Use for GCP projects. |
# AWS
oh job upload-jar my-transformer \
--options s3.path=s3://my-bucket/jars/my-transformer-1.0.jar
# GCP
oh job upload-jar my-transformer \
--options gcs.path=gs://my-bucket/jars/my-transformer-1.0.jar
oh job replace-jar NAME
Replaces an existing JAR with a new version.
Special parameters
Uses the same s3.path / gcs.path parameters as upload-jar.
# AWS
oh job replace-jar my-transformer \
--options s3.path=s3://my-bucket/jars/my-transformer-1.1.jar
# GCP
oh job replace-jar my-transformer \
--options gcs.path=gs://my-bucket/jars/my-transformer-1.1.jar