大數(shù)據(jù)之ApacheBeam使用FlinkRunner管道參數(shù)

例子

Flink集群

mvn package exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--runner=FlinkRunner --flinkMaster=<flink master> --filesToStage=target/word-count-beam-bundled-0.1.jar --inputFile=/path/to/quickstart/pom.xml --output=/tmp/counts" -Pflink-runner

管道參數(shù)說明

在丘北等地區(qū)，都構(gòu)建了全面的區(qū)域性戰(zhàn)略布局，加強(qiáng)發(fā)展的系統(tǒng)性、市場(chǎng)前瞻性、產(chǎn)品創(chuàng)新能力，以專注、極致的服務(wù)理念，為客戶提供網(wǎng)站建設(shè)、做網(wǎng)站 網(wǎng)站設(shè)計(jì)制作按需搭建網(wǎng)站,公司網(wǎng)站建設(shè),企業(yè)網(wǎng)站建設(shè),高端網(wǎng)站設(shè)計(jì),全網(wǎng)營(yíng)銷推廣,外貿(mào)網(wǎng)站制作,丘北網(wǎng)站建設(shè)費(fèi)用合理。

Field	Description	Default Value
runner	The pipeline runner to use. This option allows you to determine the pipeline runner at runtime.	Set to FlinkRunnerto run using Flink.
streaming	Whether streaming mode is enabled or disabled; true if enabled. Set to true if running pipelines with unbounded PCollections.	false
flinkMaster	The url of the Flink JobManager on which to execute pipelines. This can either be the address of a cluster JobManager, in the form "host:port" or one of the special Strings "[local]" or "[auto]". "[local]" will start a local Flink Cluster in the JVM while "[auto]" will let the system decide where to execute the pipeline based on the environment.	[auto]
filesToStage	Jar Files to send to all workers and put on the classpath. Here you have to put the fat jar that contains your program along with all dependencies.	empty
parallelism	The degree of parallelism to be used when distributing operations onto workers.	1
checkpointingInterval	The interval between consecutive checkpoints (i.e. snapshots of the current pipeline state used for fault tolerance).	-1L, i.e. disabled
numberOfExecutionRetries	Sets the number of times that failed tasks are re-executed. A value of 0 effectively disables fault tolerance. A value of -1 indicates that the system default value (as defined in the configuration) should be used.	-1
executionRetryDelay	Sets the delay between executions. A value of -1 indicates that the default value should be used.	-1
stateBackend	Sets the state backend to use in streaming mode. The default is to read this setting from the Flink config.	empty, i.e. read from Flink config

網(wǎng)頁標(biāo)題：大數(shù)據(jù)之ApacheBeam使用FlinkRunner管道參數(shù)
文章路徑：http://muchs.cn/article36/pgdopg.html

成都網(wǎng)站建設(shè)公司_創(chuàng)新互聯(lián)，為您提供響應(yīng)式網(wǎng)站、域名注冊(cè)、服務(wù)器托管、網(wǎng)站設(shè)計(jì)公司、電子商務(wù)、網(wǎng)站收錄

廣告

聲明：本網(wǎng)站發(fā)布的內(nèi)容（圖片、視頻和文字）以用戶投稿、用戶轉(zhuǎn)載內(nèi)容為主，如果涉及侵權(quán)請(qǐng)盡快告知，我們將會(huì)在第一時(shí)間刪除。文章觀點(diǎn)不代表本網(wǎng)站立場(chǎng)，如需處理請(qǐng)聯(lián)系客服。電話：028-86922220；郵箱：631063699@qq.com。內(nèi)容未經(jīng)允許不得轉(zhuǎn)載，或轉(zhuǎn)載時(shí)需注明來源： 創(chuàng)新互聯(lián)