Page tree

2017-07-25 Apache Spark 2.2.0 官方文档中文版发布 :

MachineLearning 优酷地址 :

Skip to end of metadata
Go to start of metadata

Apache Kafka is publish-subscribe messaging rethought as a distributed, partitioned, replicated commit log service. Please read the Kafka documentation thoroughly before starting an integration using Spark.

The Kafka project introduced a new consumer api between versions 0.8 and 0.10, so there are 2 separate corresponding Spark Streaming packages available. Please choose the correct package for your brokers and desired features; note that the 0.8 integration is compatible with later 0.9 and 0.10 brokers, but the 0.10 integration is not compatible with earlier brokers.

Broker Version0.8.2.1 or higher0.10.0 or higher
Api StabilityStableExperimental
Language SupportScala, Java, PythonScala, Java
Receiver DStreamYesNo
Direct DStreamYesYes
SSL / TLS SupportNoYes
Offset Commit ApiNoYes
Dynamic Topic SubscriptionNoYes
  • No labels