Use to kafka_lib library in monasca common

kafka_python 0.9.5 was moved to monasca common
Upstream community wants to move to
newer version of kafka python which has number of
performance problems.
See https://review.openstack.org/#/c/420579/
and
https://review.openstack.org/#/c/424840/
Monasca transform
uses kafka python library to write aggregated
metrics to kafka as well as read offset information
in case of hourly aggregation. Since long term
plan is to move to pykafka in the future we will
have to investigate if that functionality
is available.

Change-Id: I831c9e259b3d7b92fb2834193034e15b62c80c37
This commit is contained in:
agatea 2017-03-14 18:52:46 -07:00 committed by agatea
parent a64f1247a8
commit 8aef98d2d2
3 changed files with 5 additions and 6 deletions

View File

@ -14,8 +14,8 @@
import abc
import json
from kafka import KafkaClient
from kafka import SimpleProducer
from monasca_common.kafka_lib.client import KafkaClient
from monasca_common.kafka_lib.producer import SimpleProducer
from monasca_common.simport import simport
from oslo_config import cfg

View File

@ -11,8 +11,8 @@
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations
# under the License.
from kafka.common import OffsetRequest
from kafka import KafkaClient
from monasca_common.kafka_lib.client import KafkaClient
from monasca_common.kafka_lib.common import OffsetRequest
from pyspark.sql import SQLContext
from pyspark.streaming.kafka import KafkaUtils

View File

@ -5,9 +5,8 @@ pbr>=1.8 # Apache-2.0
PyMySQL>=0.7.6 # MIT License
six>=1.9.0 # MIT
SQLAlchemy<1.1.0,>=1.0.10 # MIT
kafka-python<1.0.0,>=0.9.5 # Apache-2.0
stevedore>=1.17.1 # Apache-2.0
monasca-common>=1.0.0 # Apache-2.0
monasca-common>=1.4.0 # Apache-2.0
oslo.config!=3.18.0,>=3.14.0 # Apache-2.0
oslo.log>=3.11.0 # Apache-2.0
oslo.service>=1.10.0 # Apache-2.0