1. Packages
  2. Google Cloud Native
  3. API Docs
  4. dataproc
  5. dataproc/v1beta2
  6. getJob

Google Cloud Native is in preview. Google Cloud Classic is fully supported.

Google Cloud Native v0.32.0 published on Wednesday, Nov 29, 2023 by Pulumi

google-native.dataproc/v1beta2.getJob

Explore with Pulumi AI

Google Cloud Native is in preview. Google Cloud Classic is fully supported.

Google Cloud Native v0.32.0 published on Wednesday, Nov 29, 2023 by Pulumi

Gets the resource representation for a job in a project.

Using getJob

Two invocation forms are available. The direct form accepts plain arguments and either blocks until the result value is available, or returns a Promise-wrapped result. The output form accepts Input-wrapped arguments and returns an Output-wrapped result.

function getJob(args: GetJobArgs, opts?: InvokeOptions): Promise<GetJobResult>
function getJobOutput(args: GetJobOutputArgs, opts?: InvokeOptions): Output<GetJobResult>
Copy
def get_job(job_id: Optional[str] = None,
            project: Optional[str] = None,
            region: Optional[str] = None,
            opts: Optional[InvokeOptions] = None) -> GetJobResult
def get_job_output(job_id: Optional[pulumi.Input[str]] = None,
            project: Optional[pulumi.Input[str]] = None,
            region: Optional[pulumi.Input[str]] = None,
            opts: Optional[InvokeOptions] = None) -> Output[GetJobResult]
Copy
func LookupJob(ctx *Context, args *LookupJobArgs, opts ...InvokeOption) (*LookupJobResult, error)
func LookupJobOutput(ctx *Context, args *LookupJobOutputArgs, opts ...InvokeOption) LookupJobResultOutput
Copy

> Note: This function is named LookupJob in the Go SDK.

public static class GetJob 
{
    public static Task<GetJobResult> InvokeAsync(GetJobArgs args, InvokeOptions? opts = null)
    public static Output<GetJobResult> Invoke(GetJobInvokeArgs args, InvokeOptions? opts = null)
}
Copy
public static CompletableFuture<GetJobResult> getJob(GetJobArgs args, InvokeOptions options)
public static Output<GetJobResult> getJob(GetJobArgs args, InvokeOptions options)
Copy
fn::invoke:
  function: google-native:dataproc/v1beta2:getJob
  arguments:
    # arguments dictionary
Copy

The following arguments are supported:

JobId This property is required. string
Region This property is required. string
Project string
JobId This property is required. string
Region This property is required. string
Project string
jobId This property is required. String
region This property is required. String
project String
jobId This property is required. string
region This property is required. string
project string
job_id This property is required. str
region This property is required. str
project str
jobId This property is required. String
region This property is required. String
project String

getJob Result

The following output properties are available:

Done bool
Indicates whether the job is completed. If the value is false, the job is still in progress. If true, the job is completed, and status.state field will indicate if it was successful, failed, or cancelled.
DriverControlFilesUri string
If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.
DriverOutputResourceUri string
A URI pointing to the location of the stdout of the job's driver program.
HadoopJob Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.HadoopJobResponse
Optional. Job is a Hadoop job.
HiveJob Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.HiveJobResponse
Optional. Job is a Hive job.
JobUuid string
A UUID that uniquely identifies a job within the project over time. This is in contrast to a user-settable reference.job_id that may be reused over time.
Labels Dictionary<string, string>
Optional. The labels to associate with this job. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with a job.
PigJob Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.PigJobResponse
Optional. Job is a Pig job.
Placement Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.JobPlacementResponse
Job information, including how, when, and where to run the job.
PrestoJob Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.PrestoJobResponse
Optional. Job is a Presto job.
PysparkJob Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.PySparkJobResponse
Optional. Job is a PySpark job.
Reference Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.JobReferenceResponse
Optional. The fully qualified reference to the job, which can be used to obtain the equivalent REST path of the job resource. If this property is not specified when a job is created, the server generates a job_id.
Scheduling Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.JobSchedulingResponse
Optional. Job scheduling configuration.
SparkJob Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.SparkJobResponse
Optional. Job is a Spark job.
SparkRJob Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.SparkRJobResponse
Optional. Job is a SparkR job.
SparkSqlJob Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.SparkSqlJobResponse
Optional. Job is a SparkSql job.
Status Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.JobStatusResponse
The job status. Additional application-specific status information may be contained in the type_job and yarn_applications fields.
StatusHistory List<Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.JobStatusResponse>
The previous job status.
SubmittedBy string
The email address of the user submitting the job. For jobs submitted on the cluster, the address is username@hostname.
YarnApplications List<Pulumi.GoogleNative.Dataproc.V1Beta2.Outputs.YarnApplicationResponse>
The collection of YARN applications spun up by this job.Beta Feature: This report is available for testing purposes only. It may be changed before final release.
Done bool
Indicates whether the job is completed. If the value is false, the job is still in progress. If true, the job is completed, and status.state field will indicate if it was successful, failed, or cancelled.
DriverControlFilesUri string
If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.
DriverOutputResourceUri string
A URI pointing to the location of the stdout of the job's driver program.
HadoopJob HadoopJobResponse
Optional. Job is a Hadoop job.
HiveJob HiveJobResponse
Optional. Job is a Hive job.
JobUuid string
A UUID that uniquely identifies a job within the project over time. This is in contrast to a user-settable reference.job_id that may be reused over time.
Labels map[string]string
Optional. The labels to associate with this job. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with a job.
PigJob PigJobResponse
Optional. Job is a Pig job.
Placement JobPlacementResponse
Job information, including how, when, and where to run the job.
PrestoJob PrestoJobResponse
Optional. Job is a Presto job.
PysparkJob PySparkJobResponse
Optional. Job is a PySpark job.
Reference JobReferenceResponse
Optional. The fully qualified reference to the job, which can be used to obtain the equivalent REST path of the job resource. If this property is not specified when a job is created, the server generates a job_id.
Scheduling JobSchedulingResponse
Optional. Job scheduling configuration.
SparkJob SparkJobResponse
Optional. Job is a Spark job.
SparkRJob SparkRJobResponse
Optional. Job is a SparkR job.
SparkSqlJob SparkSqlJobResponse
Optional. Job is a SparkSql job.
Status JobStatusResponse
The job status. Additional application-specific status information may be contained in the type_job and yarn_applications fields.
StatusHistory []JobStatusResponse
The previous job status.
SubmittedBy string
The email address of the user submitting the job. For jobs submitted on the cluster, the address is username@hostname.
YarnApplications []YarnApplicationResponse
The collection of YARN applications spun up by this job.Beta Feature: This report is available for testing purposes only. It may be changed before final release.
done Boolean
Indicates whether the job is completed. If the value is false, the job is still in progress. If true, the job is completed, and status.state field will indicate if it was successful, failed, or cancelled.
driverControlFilesUri String
If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.
driverOutputResourceUri String
A URI pointing to the location of the stdout of the job's driver program.
hadoopJob HadoopJobResponse
Optional. Job is a Hadoop job.
hiveJob HiveJobResponse
Optional. Job is a Hive job.
jobUuid String
A UUID that uniquely identifies a job within the project over time. This is in contrast to a user-settable reference.job_id that may be reused over time.
labels Map<String,String>
Optional. The labels to associate with this job. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with a job.
pigJob PigJobResponse
Optional. Job is a Pig job.
placement JobPlacementResponse
Job information, including how, when, and where to run the job.
prestoJob PrestoJobResponse
Optional. Job is a Presto job.
pysparkJob PySparkJobResponse
Optional. Job is a PySpark job.
reference JobReferenceResponse
Optional. The fully qualified reference to the job, which can be used to obtain the equivalent REST path of the job resource. If this property is not specified when a job is created, the server generates a job_id.
scheduling JobSchedulingResponse
Optional. Job scheduling configuration.
sparkJob SparkJobResponse
Optional. Job is a Spark job.
sparkRJob SparkRJobResponse
Optional. Job is a SparkR job.
sparkSqlJob SparkSqlJobResponse
Optional. Job is a SparkSql job.
status JobStatusResponse
The job status. Additional application-specific status information may be contained in the type_job and yarn_applications fields.
statusHistory List<JobStatusResponse>
The previous job status.
submittedBy String
The email address of the user submitting the job. For jobs submitted on the cluster, the address is username@hostname.
yarnApplications List<YarnApplicationResponse>
The collection of YARN applications spun up by this job.Beta Feature: This report is available for testing purposes only. It may be changed before final release.
done boolean
Indicates whether the job is completed. If the value is false, the job is still in progress. If true, the job is completed, and status.state field will indicate if it was successful, failed, or cancelled.
driverControlFilesUri string
If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.
driverOutputResourceUri string
A URI pointing to the location of the stdout of the job's driver program.
hadoopJob HadoopJobResponse
Optional. Job is a Hadoop job.
hiveJob HiveJobResponse
Optional. Job is a Hive job.
jobUuid string
A UUID that uniquely identifies a job within the project over time. This is in contrast to a user-settable reference.job_id that may be reused over time.
labels {[key: string]: string}
Optional. The labels to associate with this job. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with a job.
pigJob PigJobResponse
Optional. Job is a Pig job.
placement JobPlacementResponse
Job information, including how, when, and where to run the job.
prestoJob PrestoJobResponse
Optional. Job is a Presto job.
pysparkJob PySparkJobResponse
Optional. Job is a PySpark job.
reference JobReferenceResponse
Optional. The fully qualified reference to the job, which can be used to obtain the equivalent REST path of the job resource. If this property is not specified when a job is created, the server generates a job_id.
scheduling JobSchedulingResponse
Optional. Job scheduling configuration.
sparkJob SparkJobResponse
Optional. Job is a Spark job.
sparkRJob SparkRJobResponse
Optional. Job is a SparkR job.
sparkSqlJob SparkSqlJobResponse
Optional. Job is a SparkSql job.
status JobStatusResponse
The job status. Additional application-specific status information may be contained in the type_job and yarn_applications fields.
statusHistory JobStatusResponse[]
The previous job status.
submittedBy string
The email address of the user submitting the job. For jobs submitted on the cluster, the address is username@hostname.
yarnApplications YarnApplicationResponse[]
The collection of YARN applications spun up by this job.Beta Feature: This report is available for testing purposes only. It may be changed before final release.
done bool
Indicates whether the job is completed. If the value is false, the job is still in progress. If true, the job is completed, and status.state field will indicate if it was successful, failed, or cancelled.
driver_control_files_uri str
If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.
driver_output_resource_uri str
A URI pointing to the location of the stdout of the job's driver program.
hadoop_job HadoopJobResponse
Optional. Job is a Hadoop job.
hive_job HiveJobResponse
Optional. Job is a Hive job.
job_uuid str
A UUID that uniquely identifies a job within the project over time. This is in contrast to a user-settable reference.job_id that may be reused over time.
labels Mapping[str, str]
Optional. The labels to associate with this job. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with a job.
pig_job PigJobResponse
Optional. Job is a Pig job.
placement JobPlacementResponse
Job information, including how, when, and where to run the job.
presto_job PrestoJobResponse
Optional. Job is a Presto job.
pyspark_job PySparkJobResponse
Optional. Job is a PySpark job.
reference JobReferenceResponse
Optional. The fully qualified reference to the job, which can be used to obtain the equivalent REST path of the job resource. If this property is not specified when a job is created, the server generates a job_id.
scheduling JobSchedulingResponse
Optional. Job scheduling configuration.
spark_job SparkJobResponse
Optional. Job is a Spark job.
spark_r_job SparkRJobResponse
Optional. Job is a SparkR job.
spark_sql_job SparkSqlJobResponse
Optional. Job is a SparkSql job.
status JobStatusResponse
The job status. Additional application-specific status information may be contained in the type_job and yarn_applications fields.
status_history Sequence[JobStatusResponse]
The previous job status.
submitted_by str
The email address of the user submitting the job. For jobs submitted on the cluster, the address is username@hostname.
yarn_applications Sequence[YarnApplicationResponse]
The collection of YARN applications spun up by this job.Beta Feature: This report is available for testing purposes only. It may be changed before final release.
done Boolean
Indicates whether the job is completed. If the value is false, the job is still in progress. If true, the job is completed, and status.state field will indicate if it was successful, failed, or cancelled.
driverControlFilesUri String
If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.
driverOutputResourceUri String
A URI pointing to the location of the stdout of the job's driver program.
hadoopJob Property Map
Optional. Job is a Hadoop job.
hiveJob Property Map
Optional. Job is a Hive job.
jobUuid String
A UUID that uniquely identifies a job within the project over time. This is in contrast to a user-settable reference.job_id that may be reused over time.
labels Map<String>
Optional. The labels to associate with this job. Label keys must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035 (https://www.ietf.org/rfc/rfc1035.txt). No more than 32 labels can be associated with a job.
pigJob Property Map
Optional. Job is a Pig job.
placement Property Map
Job information, including how, when, and where to run the job.
prestoJob Property Map
Optional. Job is a Presto job.
pysparkJob Property Map
Optional. Job is a PySpark job.
reference Property Map
Optional. The fully qualified reference to the job, which can be used to obtain the equivalent REST path of the job resource. If this property is not specified when a job is created, the server generates a job_id.
scheduling Property Map
Optional. Job scheduling configuration.
sparkJob Property Map
Optional. Job is a Spark job.
sparkRJob Property Map
Optional. Job is a SparkR job.
sparkSqlJob Property Map
Optional. Job is a SparkSql job.
status Property Map
The job status. Additional application-specific status information may be contained in the type_job and yarn_applications fields.
statusHistory List<Property Map>
The previous job status.
submittedBy String
The email address of the user submitting the job. For jobs submitted on the cluster, the address is username@hostname.
yarnApplications List<Property Map>
The collection of YARN applications spun up by this job.Beta Feature: This report is available for testing purposes only. It may be changed before final release.

Supporting Types

HadoopJobResponse

ArchiveUris This property is required. List<string>
Optional. HCFS URIs of archives to be extracted in the working directory of Hadoop drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, or .zip.
Args This property is required. List<string>
Optional. The arguments to pass to the driver. Do not include arguments, such as -libjars or -Dfoo=bar, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
FileUris This property is required. List<string>
Optional. HCFS (Hadoop Compatible Filesystem) URIs of files to be copied to the working directory of Hadoop drivers and distributed tasks. Useful for naively parallel tasks.
JarFileUris This property is required. List<string>
Optional. Jar file URIs to add to the CLASSPATHs of the Hadoop driver and tasks.
LoggingConfig This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.LoggingConfigResponse
Optional. The runtime log config for job execution.
MainClass This property is required. string
The name of the driver's main class. The jar file containing the class must be in the default CLASSPATH or specified in jar_file_uris.
MainJarFileUri This property is required. string
The HCFS URI of the jar file containing the main class. Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar' 'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'
Properties This property is required. Dictionary<string, string>
Optional. A mapping of property names to values, used to configure Hadoop. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site and classes in user code.
ArchiveUris This property is required. []string
Optional. HCFS URIs of archives to be extracted in the working directory of Hadoop drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, or .zip.
Args This property is required. []string
Optional. The arguments to pass to the driver. Do not include arguments, such as -libjars or -Dfoo=bar, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
FileUris This property is required. []string
Optional. HCFS (Hadoop Compatible Filesystem) URIs of files to be copied to the working directory of Hadoop drivers and distributed tasks. Useful for naively parallel tasks.
JarFileUris This property is required. []string
Optional. Jar file URIs to add to the CLASSPATHs of the Hadoop driver and tasks.
LoggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
MainClass This property is required. string
The name of the driver's main class. The jar file containing the class must be in the default CLASSPATH or specified in jar_file_uris.
MainJarFileUri This property is required. string
The HCFS URI of the jar file containing the main class. Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar' 'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'
Properties This property is required. map[string]string
Optional. A mapping of property names to values, used to configure Hadoop. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site and classes in user code.
archiveUris This property is required. List<String>
Optional. HCFS URIs of archives to be extracted in the working directory of Hadoop drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, or .zip.
args This property is required. List<String>
Optional. The arguments to pass to the driver. Do not include arguments, such as -libjars or -Dfoo=bar, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. List<String>
Optional. HCFS (Hadoop Compatible Filesystem) URIs of files to be copied to the working directory of Hadoop drivers and distributed tasks. Useful for naively parallel tasks.
jarFileUris This property is required. List<String>
Optional. Jar file URIs to add to the CLASSPATHs of the Hadoop driver and tasks.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
mainClass This property is required. String
The name of the driver's main class. The jar file containing the class must be in the default CLASSPATH or specified in jar_file_uris.
mainJarFileUri This property is required. String
The HCFS URI of the jar file containing the main class. Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar' 'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'
properties This property is required. Map<String,String>
Optional. A mapping of property names to values, used to configure Hadoop. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site and classes in user code.
archiveUris This property is required. string[]
Optional. HCFS URIs of archives to be extracted in the working directory of Hadoop drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, or .zip.
args This property is required. string[]
Optional. The arguments to pass to the driver. Do not include arguments, such as -libjars or -Dfoo=bar, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. string[]
Optional. HCFS (Hadoop Compatible Filesystem) URIs of files to be copied to the working directory of Hadoop drivers and distributed tasks. Useful for naively parallel tasks.
jarFileUris This property is required. string[]
Optional. Jar file URIs to add to the CLASSPATHs of the Hadoop driver and tasks.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
mainClass This property is required. string
The name of the driver's main class. The jar file containing the class must be in the default CLASSPATH or specified in jar_file_uris.
mainJarFileUri This property is required. string
The HCFS URI of the jar file containing the main class. Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar' 'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'
properties This property is required. {[key: string]: string}
Optional. A mapping of property names to values, used to configure Hadoop. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site and classes in user code.
archive_uris This property is required. Sequence[str]
Optional. HCFS URIs of archives to be extracted in the working directory of Hadoop drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, or .zip.
args This property is required. Sequence[str]
Optional. The arguments to pass to the driver. Do not include arguments, such as -libjars or -Dfoo=bar, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
file_uris This property is required. Sequence[str]
Optional. HCFS (Hadoop Compatible Filesystem) URIs of files to be copied to the working directory of Hadoop drivers and distributed tasks. Useful for naively parallel tasks.
jar_file_uris This property is required. Sequence[str]
Optional. Jar file URIs to add to the CLASSPATHs of the Hadoop driver and tasks.
logging_config This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
main_class This property is required. str
The name of the driver's main class. The jar file containing the class must be in the default CLASSPATH or specified in jar_file_uris.
main_jar_file_uri This property is required. str
The HCFS URI of the jar file containing the main class. Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar' 'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'
properties This property is required. Mapping[str, str]
Optional. A mapping of property names to values, used to configure Hadoop. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site and classes in user code.
archiveUris This property is required. List<String>
Optional. HCFS URIs of archives to be extracted in the working directory of Hadoop drivers and tasks. Supported file types: .jar, .tar, .tar.gz, .tgz, or .zip.
args This property is required. List<String>
Optional. The arguments to pass to the driver. Do not include arguments, such as -libjars or -Dfoo=bar, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. List<String>
Optional. HCFS (Hadoop Compatible Filesystem) URIs of files to be copied to the working directory of Hadoop drivers and distributed tasks. Useful for naively parallel tasks.
jarFileUris This property is required. List<String>
Optional. Jar file URIs to add to the CLASSPATHs of the Hadoop driver and tasks.
loggingConfig This property is required. Property Map
Optional. The runtime log config for job execution.
mainClass This property is required. String
The name of the driver's main class. The jar file containing the class must be in the default CLASSPATH or specified in jar_file_uris.
mainJarFileUri This property is required. String
The HCFS URI of the jar file containing the main class. Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar' 'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'
properties This property is required. Map<String>
Optional. A mapping of property names to values, used to configure Hadoop. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site and classes in user code.

HiveJobResponse

ContinueOnFailure This property is required. bool
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
JarFileUris This property is required. List<string>
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Hive server and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs.
Properties This property is required. Dictionary<string, string>
Optional. A mapping of property names and values, used to configure Hive. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/hive/conf/hive-site.xml, and classes in user code.
QueryFileUri This property is required. string
The HCFS URI of the script that contains Hive queries.
QueryList This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.QueryListResponse
A list of queries.
ScriptVariables This property is required. Dictionary<string, string>
Optional. Mapping of query variable names to values (equivalent to the Hive command: SET name="value";).
ContinueOnFailure This property is required. bool
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
JarFileUris This property is required. []string
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Hive server and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs.
Properties This property is required. map[string]string
Optional. A mapping of property names and values, used to configure Hive. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/hive/conf/hive-site.xml, and classes in user code.
QueryFileUri This property is required. string
The HCFS URI of the script that contains Hive queries.
QueryList This property is required. QueryListResponse
A list of queries.
ScriptVariables This property is required. map[string]string
Optional. Mapping of query variable names to values (equivalent to the Hive command: SET name="value";).
continueOnFailure This property is required. Boolean
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
jarFileUris This property is required. List<String>
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Hive server and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs.
properties This property is required. Map<String,String>
Optional. A mapping of property names and values, used to configure Hive. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/hive/conf/hive-site.xml, and classes in user code.
queryFileUri This property is required. String
The HCFS URI of the script that contains Hive queries.
queryList This property is required. QueryListResponse
A list of queries.
scriptVariables This property is required. Map<String,String>
Optional. Mapping of query variable names to values (equivalent to the Hive command: SET name="value";).
continueOnFailure This property is required. boolean
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
jarFileUris This property is required. string[]
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Hive server and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs.
properties This property is required. {[key: string]: string}
Optional. A mapping of property names and values, used to configure Hive. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/hive/conf/hive-site.xml, and classes in user code.
queryFileUri This property is required. string
The HCFS URI of the script that contains Hive queries.
queryList This property is required. QueryListResponse
A list of queries.
scriptVariables This property is required. {[key: string]: string}
Optional. Mapping of query variable names to values (equivalent to the Hive command: SET name="value";).
continue_on_failure This property is required. bool
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
jar_file_uris This property is required. Sequence[str]
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Hive server and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs.
properties This property is required. Mapping[str, str]
Optional. A mapping of property names and values, used to configure Hive. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/hive/conf/hive-site.xml, and classes in user code.
query_file_uri This property is required. str
The HCFS URI of the script that contains Hive queries.
query_list This property is required. QueryListResponse
A list of queries.
script_variables This property is required. Mapping[str, str]
Optional. Mapping of query variable names to values (equivalent to the Hive command: SET name="value";).
continueOnFailure This property is required. Boolean
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
jarFileUris This property is required. List<String>
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Hive server and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs.
properties This property is required. Map<String>
Optional. A mapping of property names and values, used to configure Hive. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/hive/conf/hive-site.xml, and classes in user code.
queryFileUri This property is required. String
The HCFS URI of the script that contains Hive queries.
queryList This property is required. Property Map
A list of queries.
scriptVariables This property is required. Map<String>
Optional. Mapping of query variable names to values (equivalent to the Hive command: SET name="value";).

JobPlacementResponse

ClusterLabels This property is required. Dictionary<string, string>
Optional. Cluster labels to identify a cluster where the job will be submitted.
ClusterName This property is required. string
The name of the cluster where the job will be submitted.
ClusterUuid This property is required. string
A cluster UUID generated by the Dataproc service when the job is submitted.
ClusterLabels This property is required. map[string]string
Optional. Cluster labels to identify a cluster where the job will be submitted.
ClusterName This property is required. string
The name of the cluster where the job will be submitted.
ClusterUuid This property is required. string
A cluster UUID generated by the Dataproc service when the job is submitted.
clusterLabels This property is required. Map<String,String>
Optional. Cluster labels to identify a cluster where the job will be submitted.
clusterName This property is required. String
The name of the cluster where the job will be submitted.
clusterUuid This property is required. String
A cluster UUID generated by the Dataproc service when the job is submitted.
clusterLabels This property is required. {[key: string]: string}
Optional. Cluster labels to identify a cluster where the job will be submitted.
clusterName This property is required. string
The name of the cluster where the job will be submitted.
clusterUuid This property is required. string
A cluster UUID generated by the Dataproc service when the job is submitted.
cluster_labels This property is required. Mapping[str, str]
Optional. Cluster labels to identify a cluster where the job will be submitted.
cluster_name This property is required. str
The name of the cluster where the job will be submitted.
cluster_uuid This property is required. str
A cluster UUID generated by the Dataproc service when the job is submitted.
clusterLabels This property is required. Map<String>
Optional. Cluster labels to identify a cluster where the job will be submitted.
clusterName This property is required. String
The name of the cluster where the job will be submitted.
clusterUuid This property is required. String
A cluster UUID generated by the Dataproc service when the job is submitted.

JobReferenceResponse

JobId This property is required. string
Optional. The job ID, which must be unique within the project. The ID must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), or hyphens (-). The maximum length is 100 characters.If not specified by the caller, the job ID will be provided by the server.
Project This property is required. string
Optional. The ID of the Google Cloud Platform project that the job belongs to. If specified, must match the request project ID.
JobId This property is required. string
Optional. The job ID, which must be unique within the project. The ID must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), or hyphens (-). The maximum length is 100 characters.If not specified by the caller, the job ID will be provided by the server.
Project This property is required. string
Optional. The ID of the Google Cloud Platform project that the job belongs to. If specified, must match the request project ID.
jobId This property is required. String
Optional. The job ID, which must be unique within the project. The ID must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), or hyphens (-). The maximum length is 100 characters.If not specified by the caller, the job ID will be provided by the server.
project This property is required. String
Optional. The ID of the Google Cloud Platform project that the job belongs to. If specified, must match the request project ID.
jobId This property is required. string
Optional. The job ID, which must be unique within the project. The ID must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), or hyphens (-). The maximum length is 100 characters.If not specified by the caller, the job ID will be provided by the server.
project This property is required. string
Optional. The ID of the Google Cloud Platform project that the job belongs to. If specified, must match the request project ID.
job_id This property is required. str
Optional. The job ID, which must be unique within the project. The ID must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), or hyphens (-). The maximum length is 100 characters.If not specified by the caller, the job ID will be provided by the server.
project This property is required. str
Optional. The ID of the Google Cloud Platform project that the job belongs to. If specified, must match the request project ID.
jobId This property is required. String
Optional. The job ID, which must be unique within the project. The ID must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), or hyphens (-). The maximum length is 100 characters.If not specified by the caller, the job ID will be provided by the server.
project This property is required. String
Optional. The ID of the Google Cloud Platform project that the job belongs to. If specified, must match the request project ID.

JobSchedulingResponse

MaxFailuresPerHour This property is required. int
Optional. Maximum number of times per hour a driver may be restarted as a result of driver terminating with non-zero code before job is reported failed.A job may be reported as thrashing if driver exits with non-zero code 4 times within 10 minute window.Maximum value is 10.
MaxFailuresTotal This property is required. int
Optional. Maximum number of times in total a driver may be restarted as a result of driver exiting with non-zero code before job is reported failed. Maximum value is 240.
MaxFailuresPerHour This property is required. int
Optional. Maximum number of times per hour a driver may be restarted as a result of driver terminating with non-zero code before job is reported failed.A job may be reported as thrashing if driver exits with non-zero code 4 times within 10 minute window.Maximum value is 10.
MaxFailuresTotal This property is required. int
Optional. Maximum number of times in total a driver may be restarted as a result of driver exiting with non-zero code before job is reported failed. Maximum value is 240.
maxFailuresPerHour This property is required. Integer
Optional. Maximum number of times per hour a driver may be restarted as a result of driver terminating with non-zero code before job is reported failed.A job may be reported as thrashing if driver exits with non-zero code 4 times within 10 minute window.Maximum value is 10.
maxFailuresTotal This property is required. Integer
Optional. Maximum number of times in total a driver may be restarted as a result of driver exiting with non-zero code before job is reported failed. Maximum value is 240.
maxFailuresPerHour This property is required. number
Optional. Maximum number of times per hour a driver may be restarted as a result of driver terminating with non-zero code before job is reported failed.A job may be reported as thrashing if driver exits with non-zero code 4 times within 10 minute window.Maximum value is 10.
maxFailuresTotal This property is required. number
Optional. Maximum number of times in total a driver may be restarted as a result of driver exiting with non-zero code before job is reported failed. Maximum value is 240.
max_failures_per_hour This property is required. int
Optional. Maximum number of times per hour a driver may be restarted as a result of driver terminating with non-zero code before job is reported failed.A job may be reported as thrashing if driver exits with non-zero code 4 times within 10 minute window.Maximum value is 10.
max_failures_total This property is required. int
Optional. Maximum number of times in total a driver may be restarted as a result of driver exiting with non-zero code before job is reported failed. Maximum value is 240.
maxFailuresPerHour This property is required. Number
Optional. Maximum number of times per hour a driver may be restarted as a result of driver terminating with non-zero code before job is reported failed.A job may be reported as thrashing if driver exits with non-zero code 4 times within 10 minute window.Maximum value is 10.
maxFailuresTotal This property is required. Number
Optional. Maximum number of times in total a driver may be restarted as a result of driver exiting with non-zero code before job is reported failed. Maximum value is 240.

JobStatusResponse

Details This property is required. string
Optional Job state details, such as an error description if the state is ERROR.
State This property is required. string
A state message specifying the overall job state.
StateStartTime This property is required. string
The time when this state was entered.
Substate This property is required. string
Additional state information, which includes status reported by the agent.
Details This property is required. string
Optional Job state details, such as an error description if the state is ERROR.
State This property is required. string
A state message specifying the overall job state.
StateStartTime This property is required. string
The time when this state was entered.
Substate This property is required. string
Additional state information, which includes status reported by the agent.
details This property is required. String
Optional Job state details, such as an error description if the state is ERROR.
state This property is required. String
A state message specifying the overall job state.
stateStartTime This property is required. String
The time when this state was entered.
substate This property is required. String
Additional state information, which includes status reported by the agent.
details This property is required. string
Optional Job state details, such as an error description if the state is ERROR.
state This property is required. string
A state message specifying the overall job state.
stateStartTime This property is required. string
The time when this state was entered.
substate This property is required. string
Additional state information, which includes status reported by the agent.
details This property is required. str
Optional Job state details, such as an error description if the state is ERROR.
state This property is required. str
A state message specifying the overall job state.
state_start_time This property is required. str
The time when this state was entered.
substate This property is required. str
Additional state information, which includes status reported by the agent.
details This property is required. String
Optional Job state details, such as an error description if the state is ERROR.
state This property is required. String
A state message specifying the overall job state.
stateStartTime This property is required. String
The time when this state was entered.
substate This property is required. String
Additional state information, which includes status reported by the agent.

LoggingConfigResponse

DriverLogLevels This property is required. Dictionary<string, string>
The per-package log levels for the driver. This may include "root" package name to configure rootLogger. Examples: 'com.google = FATAL', 'root = INFO', 'org.apache = DEBUG'
DriverLogLevels This property is required. map[string]string
The per-package log levels for the driver. This may include "root" package name to configure rootLogger. Examples: 'com.google = FATAL', 'root = INFO', 'org.apache = DEBUG'
driverLogLevels This property is required. Map<String,String>
The per-package log levels for the driver. This may include "root" package name to configure rootLogger. Examples: 'com.google = FATAL', 'root = INFO', 'org.apache = DEBUG'
driverLogLevels This property is required. {[key: string]: string}
The per-package log levels for the driver. This may include "root" package name to configure rootLogger. Examples: 'com.google = FATAL', 'root = INFO', 'org.apache = DEBUG'
driver_log_levels This property is required. Mapping[str, str]
The per-package log levels for the driver. This may include "root" package name to configure rootLogger. Examples: 'com.google = FATAL', 'root = INFO', 'org.apache = DEBUG'
driverLogLevels This property is required. Map<String>
The per-package log levels for the driver. This may include "root" package name to configure rootLogger. Examples: 'com.google = FATAL', 'root = INFO', 'org.apache = DEBUG'

PigJobResponse

ContinueOnFailure This property is required. bool
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
JarFileUris This property is required. List<string>
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
LoggingConfig This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.LoggingConfigResponse
Optional. The runtime log config for job execution.
Properties This property is required. Dictionary<string, string>
Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.
QueryFileUri This property is required. string
The HCFS URI of the script that contains the Pig queries.
QueryList This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.QueryListResponse
A list of queries.
ScriptVariables This property is required. Dictionary<string, string>
Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).
ContinueOnFailure This property is required. bool
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
JarFileUris This property is required. []string
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
LoggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
Properties This property is required. map[string]string
Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.
QueryFileUri This property is required. string
The HCFS URI of the script that contains the Pig queries.
QueryList This property is required. QueryListResponse
A list of queries.
ScriptVariables This property is required. map[string]string
Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).
continueOnFailure This property is required. Boolean
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
jarFileUris This property is required. List<String>
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
properties This property is required. Map<String,String>
Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.
queryFileUri This property is required. String
The HCFS URI of the script that contains the Pig queries.
queryList This property is required. QueryListResponse
A list of queries.
scriptVariables This property is required. Map<String,String>
Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).
continueOnFailure This property is required. boolean
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
jarFileUris This property is required. string[]
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
properties This property is required. {[key: string]: string}
Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.
queryFileUri This property is required. string
The HCFS URI of the script that contains the Pig queries.
queryList This property is required. QueryListResponse
A list of queries.
scriptVariables This property is required. {[key: string]: string}
Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).
continue_on_failure This property is required. bool
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
jar_file_uris This property is required. Sequence[str]
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
logging_config This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
properties This property is required. Mapping[str, str]
Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.
query_file_uri This property is required. str
The HCFS URI of the script that contains the Pig queries.
query_list This property is required. QueryListResponse
A list of queries.
script_variables This property is required. Mapping[str, str]
Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).
continueOnFailure This property is required. Boolean
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
jarFileUris This property is required. List<String>
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
loggingConfig This property is required. Property Map
Optional. The runtime log config for job execution.
properties This property is required. Map<String>
Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.
queryFileUri This property is required. String
The HCFS URI of the script that contains the Pig queries.
queryList This property is required. Property Map
A list of queries.
scriptVariables This property is required. Map<String>
Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).

PrestoJobResponse

ClientTags This property is required. List<string>
Optional. Presto client tags to attach to this query
ContinueOnFailure This property is required. bool
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
LoggingConfig This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.LoggingConfigResponse
Optional. The runtime log config for job execution.
OutputFormat This property is required. string
Optional. The format in which query output will be displayed. See the Presto documentation for supported output formats
Properties This property is required. Dictionary<string, string>
Optional. A mapping of property names to values. Used to set Presto session properties (https://prestodb.io/docs/current/sql/set-session.html) Equivalent to using the --session flag in the Presto CLI
QueryFileUri This property is required. string
The HCFS URI of the script that contains SQL queries.
QueryList This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.QueryListResponse
A list of queries.
ClientTags This property is required. []string
Optional. Presto client tags to attach to this query
ContinueOnFailure This property is required. bool
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
LoggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
OutputFormat This property is required. string
Optional. The format in which query output will be displayed. See the Presto documentation for supported output formats
Properties This property is required. map[string]string
Optional. A mapping of property names to values. Used to set Presto session properties (https://prestodb.io/docs/current/sql/set-session.html) Equivalent to using the --session flag in the Presto CLI
QueryFileUri This property is required. string
The HCFS URI of the script that contains SQL queries.
QueryList This property is required. QueryListResponse
A list of queries.
clientTags This property is required. List<String>
Optional. Presto client tags to attach to this query
continueOnFailure This property is required. Boolean
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
outputFormat This property is required. String
Optional. The format in which query output will be displayed. See the Presto documentation for supported output formats
properties This property is required. Map<String,String>
Optional. A mapping of property names to values. Used to set Presto session properties (https://prestodb.io/docs/current/sql/set-session.html) Equivalent to using the --session flag in the Presto CLI
queryFileUri This property is required. String
The HCFS URI of the script that contains SQL queries.
queryList This property is required. QueryListResponse
A list of queries.
clientTags This property is required. string[]
Optional. Presto client tags to attach to this query
continueOnFailure This property is required. boolean
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
outputFormat This property is required. string
Optional. The format in which query output will be displayed. See the Presto documentation for supported output formats
properties This property is required. {[key: string]: string}
Optional. A mapping of property names to values. Used to set Presto session properties (https://prestodb.io/docs/current/sql/set-session.html) Equivalent to using the --session flag in the Presto CLI
queryFileUri This property is required. string
The HCFS URI of the script that contains SQL queries.
queryList This property is required. QueryListResponse
A list of queries.
client_tags This property is required. Sequence[str]
Optional. Presto client tags to attach to this query
continue_on_failure This property is required. bool
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
logging_config This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
output_format This property is required. str
Optional. The format in which query output will be displayed. See the Presto documentation for supported output formats
properties This property is required. Mapping[str, str]
Optional. A mapping of property names to values. Used to set Presto session properties (https://prestodb.io/docs/current/sql/set-session.html) Equivalent to using the --session flag in the Presto CLI
query_file_uri This property is required. str
The HCFS URI of the script that contains SQL queries.
query_list This property is required. QueryListResponse
A list of queries.
clientTags This property is required. List<String>
Optional. Presto client tags to attach to this query
continueOnFailure This property is required. Boolean
Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.
loggingConfig This property is required. Property Map
Optional. The runtime log config for job execution.
outputFormat This property is required. String
Optional. The format in which query output will be displayed. See the Presto documentation for supported output formats
properties This property is required. Map<String>
Optional. A mapping of property names to values. Used to set Presto session properties (https://prestodb.io/docs/current/sql/set-session.html) Equivalent to using the --session flag in the Presto CLI
queryFileUri This property is required. String
The HCFS URI of the script that contains SQL queries.
queryList This property is required. Property Map
A list of queries.

PySparkJobResponse

ArchiveUris This property is required. List<string>
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
Args This property is required. List<string>
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
FileUris This property is required. List<string>
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
JarFileUris This property is required. List<string>
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Python driver and tasks.
LoggingConfig This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.LoggingConfigResponse
Optional. The runtime log config for job execution.
MainPythonFileUri This property is required. string
The HCFS URI of the main Python file to use as the driver. Must be a .py file.
Properties This property is required. Dictionary<string, string>
Optional. A mapping of property names to values, used to configure PySpark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
PythonFileUris This property is required. List<string>
Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: .py, .egg, and .zip.
ArchiveUris This property is required. []string
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
Args This property is required. []string
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
FileUris This property is required. []string
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
JarFileUris This property is required. []string
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Python driver and tasks.
LoggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
MainPythonFileUri This property is required. string
The HCFS URI of the main Python file to use as the driver. Must be a .py file.
Properties This property is required. map[string]string
Optional. A mapping of property names to values, used to configure PySpark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
PythonFileUris This property is required. []string
Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: .py, .egg, and .zip.
archiveUris This property is required. List<String>
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. List<String>
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. List<String>
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
jarFileUris This property is required. List<String>
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Python driver and tasks.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
mainPythonFileUri This property is required. String
The HCFS URI of the main Python file to use as the driver. Must be a .py file.
properties This property is required. Map<String,String>
Optional. A mapping of property names to values, used to configure PySpark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
pythonFileUris This property is required. List<String>
Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: .py, .egg, and .zip.
archiveUris This property is required. string[]
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. string[]
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. string[]
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
jarFileUris This property is required. string[]
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Python driver and tasks.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
mainPythonFileUri This property is required. string
The HCFS URI of the main Python file to use as the driver. Must be a .py file.
properties This property is required. {[key: string]: string}
Optional. A mapping of property names to values, used to configure PySpark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
pythonFileUris This property is required. string[]
Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: .py, .egg, and .zip.
archive_uris This property is required. Sequence[str]
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. Sequence[str]
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
file_uris This property is required. Sequence[str]
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
jar_file_uris This property is required. Sequence[str]
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Python driver and tasks.
logging_config This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
main_python_file_uri This property is required. str
The HCFS URI of the main Python file to use as the driver. Must be a .py file.
properties This property is required. Mapping[str, str]
Optional. A mapping of property names to values, used to configure PySpark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
python_file_uris This property is required. Sequence[str]
Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: .py, .egg, and .zip.
archiveUris This property is required. List<String>
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. List<String>
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. List<String>
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
jarFileUris This property is required. List<String>
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Python driver and tasks.
loggingConfig This property is required. Property Map
Optional. The runtime log config for job execution.
mainPythonFileUri This property is required. String
The HCFS URI of the main Python file to use as the driver. Must be a .py file.
properties This property is required. Map<String>
Optional. A mapping of property names to values, used to configure PySpark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
pythonFileUris This property is required. List<String>
Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: .py, .egg, and .zip.

QueryListResponse

Queries This property is required. List<string>
The queries to execute. You do not need to end a query expression with a semicolon. Multiple queries can be specified in one string by separating each with a semicolon. Here is an example of a Dataproc API snippet that uses a QueryList to specify a HiveJob: "hiveJob": { "queryList": { "queries": [ "query1", "query2", "query3;query4", ] } }
Queries This property is required. []string
The queries to execute. You do not need to end a query expression with a semicolon. Multiple queries can be specified in one string by separating each with a semicolon. Here is an example of a Dataproc API snippet that uses a QueryList to specify a HiveJob: "hiveJob": { "queryList": { "queries": [ "query1", "query2", "query3;query4", ] } }
queries This property is required. List<String>
The queries to execute. You do not need to end a query expression with a semicolon. Multiple queries can be specified in one string by separating each with a semicolon. Here is an example of a Dataproc API snippet that uses a QueryList to specify a HiveJob: "hiveJob": { "queryList": { "queries": [ "query1", "query2", "query3;query4", ] } }
queries This property is required. string[]
The queries to execute. You do not need to end a query expression with a semicolon. Multiple queries can be specified in one string by separating each with a semicolon. Here is an example of a Dataproc API snippet that uses a QueryList to specify a HiveJob: "hiveJob": { "queryList": { "queries": [ "query1", "query2", "query3;query4", ] } }
queries This property is required. Sequence[str]
The queries to execute. You do not need to end a query expression with a semicolon. Multiple queries can be specified in one string by separating each with a semicolon. Here is an example of a Dataproc API snippet that uses a QueryList to specify a HiveJob: "hiveJob": { "queryList": { "queries": [ "query1", "query2", "query3;query4", ] } }
queries This property is required. List<String>
The queries to execute. You do not need to end a query expression with a semicolon. Multiple queries can be specified in one string by separating each with a semicolon. Here is an example of a Dataproc API snippet that uses a QueryList to specify a HiveJob: "hiveJob": { "queryList": { "queries": [ "query1", "query2", "query3;query4", ] } }

SparkJobResponse

ArchiveUris This property is required. List<string>
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
Args This property is required. List<string>
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
FileUris This property is required. List<string>
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
JarFileUris This property is required. List<string>
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
LoggingConfig This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.LoggingConfigResponse
Optional. The runtime log config for job execution.
MainClass This property is required. string
The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris.
MainJarFileUri This property is required. string
The HCFS URI of the jar file that contains the main class.
Properties This property is required. Dictionary<string, string>
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
ArchiveUris This property is required. []string
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
Args This property is required. []string
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
FileUris This property is required. []string
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
JarFileUris This property is required. []string
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
LoggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
MainClass This property is required. string
The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris.
MainJarFileUri This property is required. string
The HCFS URI of the jar file that contains the main class.
Properties This property is required. map[string]string
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
archiveUris This property is required. List<String>
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. List<String>
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. List<String>
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
jarFileUris This property is required. List<String>
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
mainClass This property is required. String
The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris.
mainJarFileUri This property is required. String
The HCFS URI of the jar file that contains the main class.
properties This property is required. Map<String,String>
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
archiveUris This property is required. string[]
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. string[]
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. string[]
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
jarFileUris This property is required. string[]
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
mainClass This property is required. string
The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris.
mainJarFileUri This property is required. string
The HCFS URI of the jar file that contains the main class.
properties This property is required. {[key: string]: string}
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
archive_uris This property is required. Sequence[str]
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. Sequence[str]
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
file_uris This property is required. Sequence[str]
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
jar_file_uris This property is required. Sequence[str]
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
logging_config This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
main_class This property is required. str
The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris.
main_jar_file_uri This property is required. str
The HCFS URI of the jar file that contains the main class.
properties This property is required. Mapping[str, str]
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
archiveUris This property is required. List<String>
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. List<String>
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. List<String>
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
jarFileUris This property is required. List<String>
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
loggingConfig This property is required. Property Map
Optional. The runtime log config for job execution.
mainClass This property is required. String
The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris.
mainJarFileUri This property is required. String
The HCFS URI of the jar file that contains the main class.
properties This property is required. Map<String>
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.

SparkRJobResponse

ArchiveUris This property is required. List<string>
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
Args This property is required. List<string>
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
FileUris This property is required. List<string>
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
LoggingConfig This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.LoggingConfigResponse
Optional. The runtime log config for job execution.
MainRFileUri This property is required. string
The HCFS URI of the main R file to use as the driver. Must be a .R file.
Properties This property is required. Dictionary<string, string>
Optional. A mapping of property names to values, used to configure SparkR. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
ArchiveUris This property is required. []string
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
Args This property is required. []string
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
FileUris This property is required. []string
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
LoggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
MainRFileUri This property is required. string
The HCFS URI of the main R file to use as the driver. Must be a .R file.
Properties This property is required. map[string]string
Optional. A mapping of property names to values, used to configure SparkR. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
archiveUris This property is required. List<String>
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. List<String>
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. List<String>
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
mainRFileUri This property is required. String
The HCFS URI of the main R file to use as the driver. Must be a .R file.
properties This property is required. Map<String,String>
Optional. A mapping of property names to values, used to configure SparkR. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
archiveUris This property is required. string[]
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. string[]
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. string[]
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
mainRFileUri This property is required. string
The HCFS URI of the main R file to use as the driver. Must be a .R file.
properties This property is required. {[key: string]: string}
Optional. A mapping of property names to values, used to configure SparkR. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
archive_uris This property is required. Sequence[str]
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. Sequence[str]
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
file_uris This property is required. Sequence[str]
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
logging_config This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
main_r_file_uri This property is required. str
The HCFS URI of the main R file to use as the driver. Must be a .R file.
properties This property is required. Mapping[str, str]
Optional. A mapping of property names to values, used to configure SparkR. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
archiveUris This property is required. List<String>
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
args This property is required. List<String>
Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
fileUris This property is required. List<String>
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
loggingConfig This property is required. Property Map
Optional. The runtime log config for job execution.
mainRFileUri This property is required. String
The HCFS URI of the main R file to use as the driver. Must be a .R file.
properties This property is required. Map<String>
Optional. A mapping of property names to values, used to configure SparkR. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.

SparkSqlJobResponse

JarFileUris This property is required. List<string>
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
LoggingConfig This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.LoggingConfigResponse
Optional. The runtime log config for job execution.
Properties This property is required. Dictionary<string, string>
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
QueryFileUri This property is required. string
The HCFS URI of the script that contains SQL queries.
QueryList This property is required. Pulumi.GoogleNative.Dataproc.V1Beta2.Inputs.QueryListResponse
A list of queries.
ScriptVariables This property is required. Dictionary<string, string>
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).
JarFileUris This property is required. []string
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
LoggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
Properties This property is required. map[string]string
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
QueryFileUri This property is required. string
The HCFS URI of the script that contains SQL queries.
QueryList This property is required. QueryListResponse
A list of queries.
ScriptVariables This property is required. map[string]string
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).
jarFileUris This property is required. List<String>
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
properties This property is required. Map<String,String>
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
queryFileUri This property is required. String
The HCFS URI of the script that contains SQL queries.
queryList This property is required. QueryListResponse
A list of queries.
scriptVariables This property is required. Map<String,String>
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).
jarFileUris This property is required. string[]
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
loggingConfig This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
properties This property is required. {[key: string]: string}
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
queryFileUri This property is required. string
The HCFS URI of the script that contains SQL queries.
queryList This property is required. QueryListResponse
A list of queries.
scriptVariables This property is required. {[key: string]: string}
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).
jar_file_uris This property is required. Sequence[str]
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
logging_config This property is required. LoggingConfigResponse
Optional. The runtime log config for job execution.
properties This property is required. Mapping[str, str]
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
query_file_uri This property is required. str
The HCFS URI of the script that contains SQL queries.
query_list This property is required. QueryListResponse
A list of queries.
script_variables This property is required. Mapping[str, str]
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).
jarFileUris This property is required. List<String>
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
loggingConfig This property is required. Property Map
Optional. The runtime log config for job execution.
properties This property is required. Map<String>
Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten.
queryFileUri This property is required. String
The HCFS URI of the script that contains SQL queries.
queryList This property is required. Property Map
A list of queries.
scriptVariables This property is required. Map<String>
Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";).

YarnApplicationResponse

Name This property is required. string
The application name.
Progress This property is required. double
The numerical progress of the application, from 1 to 100.
State This property is required. string
The application state.
TrackingUrl This property is required. string
The HTTP URL of the ApplicationMaster, HistoryServer, or TimelineServer that provides application-specific information. The URL uses the internal hostname, and requires a proxy server for resolution and, possibly, access.
Name This property is required. string
The application name.
Progress This property is required. float64
The numerical progress of the application, from 1 to 100.
State This property is required. string
The application state.
TrackingUrl This property is required. string
The HTTP URL of the ApplicationMaster, HistoryServer, or TimelineServer that provides application-specific information. The URL uses the internal hostname, and requires a proxy server for resolution and, possibly, access.
name This property is required. String
The application name.
progress This property is required. Double
The numerical progress of the application, from 1 to 100.
state This property is required. String
The application state.
trackingUrl This property is required. String
The HTTP URL of the ApplicationMaster, HistoryServer, or TimelineServer that provides application-specific information. The URL uses the internal hostname, and requires a proxy server for resolution and, possibly, access.
name This property is required. string
The application name.
progress This property is required. number
The numerical progress of the application, from 1 to 100.
state This property is required. string
The application state.
trackingUrl This property is required. string
The HTTP URL of the ApplicationMaster, HistoryServer, or TimelineServer that provides application-specific information. The URL uses the internal hostname, and requires a proxy server for resolution and, possibly, access.
name This property is required. str
The application name.
progress This property is required. float
The numerical progress of the application, from 1 to 100.
state This property is required. str
The application state.
tracking_url This property is required. str
The HTTP URL of the ApplicationMaster, HistoryServer, or TimelineServer that provides application-specific information. The URL uses the internal hostname, and requires a proxy server for resolution and, possibly, access.
name This property is required. String
The application name.
progress This property is required. Number
The numerical progress of the application, from 1 to 100.
state This property is required. String
The application state.
trackingUrl This property is required. String
The HTTP URL of the ApplicationMaster, HistoryServer, or TimelineServer that provides application-specific information. The URL uses the internal hostname, and requires a proxy server for resolution and, possibly, access.

Package Details

Repository
Google Cloud Native pulumi/pulumi-google-native
License
Apache-2.0

Google Cloud Native is in preview. Google Cloud Classic is fully supported.

Google Cloud Native v0.32.0 published on Wednesday, Nov 29, 2023 by Pulumi