Monitoring Hive Job Activity

As Hive tasks run as pre-scheduled or event-based jobs, you can monitor the jobs as you would any other type of job in Tidal Automation using the Job Details dialog. You can also use Business Views to monitor job activity and view when the jobs are active.

To monitor job activity:

  1. Click Operations > Job Activity on the Navigation pane to display the Job Activity pane.

  2. Right-click to choose a job and choose Details from the context menu.

    The Job Details dialog appears. On the Status page, you can view the status of the job, the start and end time, how long it ran, and how it was scheduled. The external ID is the run ID associated with the specific execution of the batch job.

  3. Click Output to view the result sets from the HiveQL commands after the job completes.

    Tidal Automation can be configured to save or discard job output by default from the Defaults tab of the System Configuration dialog. Regardless of the system default, any individual job instance can be configured from its job definition to override the system default. Each time a job is rerun, that run's output is separated by a block of number signs.

    A Step Header with step number, status, and an abbreviated version of the step command is displayed before the actual result set. A Step Header can be turned off using the “PrintStepHeader” option in the connection. By default, PrintStepHeader is turned on.

    If there are multiple commands in the Hive Job, each command is run as a separate step and all steps are displayed in the Output tab sequentially.

  4. Click Hive Job to view the original request along with variables used when this job was submitted. This tab allows you to override the HiveQL commands, output format, and parameter values prior to run or rerun. Overrides are not permitted when the job is running.

    While the job is running, the fields are disabled; however, prior to running or rerunning the job, you can override any value on this screen. Your changes here only apply to this instance of the job (the original job definition is not affected).

  5. Click the Run Info tab to view the run status, start, and end time for each step in the Hive Job. This tab is read-only.

  6. Click View Details to view the Hive Job Run Info dialog.

    This dialog contains the run status, start, and end time for each step in the Hive job, the HiveQL command and its output. You can override the HiveQL command and output on this dialog.

    Additionally, you can choose a step and click Restart From to rerun a job from a particular step.

  7. Click OK to close the dialog when you have finished viewing the job activity details.