git clone https://github.com/mardambey/mypipe.git vi mypipe-runner/src/main/scala/mypipe/runner/PipeRunner.scala 55行 //shutdown() 注釋 使用的主配置文件 mypipe-runner/src/main/resources/application.conf ，修改kafka和zookper地址 mypipe-runner/target/scala-2.11/classes/application.conf (編譯后)

數(shù)據(jù)庫 過濾表 配置文件 mypipe-api/src/main/resources/reference.conf mypipe-api/target/scala-2.11/classes/reference.conf(編譯后) quit-on-empty-mutation-commit-failure = false flush-interval-seconds = 1 include-event-condition = “”” (db == “newtable” && table == “l(fā)ip”) “”“

創(chuàng)建用于訂閱數(shù)據(jù)庫的賬戶： GRANT REPLICATION SLAVE, REPLICATION CLIENT ON . TO ‘mypipe’@’%’ IDENTIFIED BY ‘mypipe’; GRANT ALL PRIVILEGES ON . TO ‘mypipe’@’%’; GRANT RELOAD ON . TO ‘mypipe’@’%’;

在用戶目錄下新增文件 用阿里云的源 vi .sbt/repositories [repositories] local osc: http://maven.aliyun.com/nexus/content/groups/public/ typesafe: http://repo.typesafe.com/typesafe/ivy-releases/, [organization]/[module]/(scala_[scalaVersion]/)(sbt_[sbtVersion]/)[revision]/[type]s/artifact.[ext], bootOnly sonatype-oss-releases maven-central sonatype-oss-snapshots

修改編譯前文件后 編譯 ./sbt clean package 啟動命令 ./sbt “project runner” “runMain mypipe.runner.PipeRunner”

kafka配置

kafka的配置文件編輯 vi consumer.properties zookeeper.connect=172.18.0.1:2181 vi server.properties zookeeper.connect=172.18.0.1:2181

啟動 kafka bin/kafka-server-start.sh config/server.properties 或者 bin/kafka-server-start.sh -daemon config/server.properties 后臺啟動

mypipe后臺方法 crtl + z jobs bg n