Commit Graph

17 Commits

Author SHA1 Message Date
Stephen Finucane d16cddd822 Move integration jobs to Ubuntu 22.04 (Jammy)
I noticed the confluent-kafka package isn't compatible with the version
of librdkafka-dev provided on Jammy [1][2]. Thankfully they provide a
binary wheel though.

[1] https://github.com/confluentinc/confluent-kafka-python/blob/v1.9.2/src/confluent_kafka/src/confluent_kafka.h#L59
[2] https://packages.ubuntu.com/jammy/librdkafka-dev

Change-Id: If55f246d9d2a990f2389d14d7bda22a82d9bb43c
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2023-10-13 17:31:11 +09:00
Sairam Vengala a3715386de test py311 job
this patch fixes the py3.11 job by updating bindep.txt

Change-Id: I8eeb1b345033269a98989ef4a563ca65fe04e57f
2023-09-28 11:04:30 +00:00
Zuul 3996d11b80 Merge "bindep: Add 'librdkafka-dev' dependency" 2021-04-16 13:11:15 +00:00
Andreas Jaeger 7e406c312a Simplify tools/test-setup.sh
test-setup.sh is called after bindep is run in CI, and tox is not setup.

Simplify the script so that it only does what's needed - install
qdrouterd for Ubuntu from qpid/testing.

Install the other packages using bindep, add test to amqp1 profile.

Add amqp1 to bindep_profiles where needed for scenario tests, previously
test-setup.sh added it everywhere.

Some tests are skipped due to changes in recent versions of kombu. These
will be unskipped when we come up with a proper fix.

Change-Id: Ic3a9e2c873619670edfbf71022d593f3cb5f70f2
Related-Bug: #1885923
2020-07-01 14:40:24 +01:00
Stephen Finucane 8d29ab3d2c bindep: Add 'librdkafka-dev' dependency
We're seeing the following in our build logs:

    In file included from confluent_kafka/src/confluent_kafka.c:17:0:
    confluent_kafka/src/confluent_kafka.h:22:10: fatal error: librdkafka/rdkafka.h: No such file or directory
     #include <librdkafka/rdkafka.h>
              ^~~~~~~~~~~~~~~~~~~~~~
    compilation terminated.
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

Resolve this by installing the development headers.

Change-Id: Idda79dc87bcd0e3367a6abd1b52104c000ad1dcd
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2020-06-02 16:07:00 +00:00
Andy Smith 8897e1584f Update messaging intermediaries for amqp1 tests
This patch messaging intermediaries used for the amqp1 driver
test. The combination of the apache qpid-dispatch-router (qdrouterd)
with an attached apache artemis broker is used in place of the qpidd
broker. The qdrouterd will directly message oslo.messaging rpc
communications and will link route oslo.messaging notify
communications to the artemis broker (e.g. for persistence).

This patch:
* updates the dependencies
* updates the test environment setup
* uses the pifpaf drivers to create servers

Change-Id: I9fb56450346fca84bc1573fa5e9b6fe81c14e33a
2019-03-11 08:47:46 -04:00
Andy Smith 5a842ae155 Switch driver to confluent-kafka client library
This patch switches the kafka python client from kafka-python to
confluent-kafka due to documented threading issues with the
kafka-python consumer and the recommendation to use multiplrocessing.
The confluent-kafka client leverages the high performance librdkafka
C client and is safe for multiple thread use.

This patch:
* switches to confluent-kafka library
* revises consumer and producer message operations
* utilizes event.tpool method for confluent-kafka blocking calls
* updates unit tests
* adds kafka specific timeouts for functional tests
* adds release note

Depends-On: Ice374dca539b8ed1b1965b75379bad5140121483
Change-Id: Idfb9fe3700d882c8285c6dc56b0620951178eba2
2018-12-04 11:25:07 -05:00
Andy Smith f2fd8d4375 Remove the deprecated ZeroMQ driver
Users of the oslo.messaging RPC communications service must use
the rabbit ("rabbit://...") or AMQP 1.0 ("amqp://...") drivers.

Change-Id: If3474142f1fe99d41d7b4466061ed0e23ca38549
Closes-Bug: 1789259
2018-08-28 16:00:50 -04:00
Kenneth Giusti 222a939361 Remove the deprecated Pika driver
It is recommended that all users of the Pika driver transition to
using the Rabbit driver instead.  Typically this is done by changing
the prefix of the transport_url configuration option from "pika://..."
to "rabbit://...".  There are no changes required to the RabbitMQ
server configuration.

Change-Id: I52ea5ccb7e7c247abd95e2d8d50dac4c4ad11246
Closes-Bug: #1744741
2018-03-21 10:58:23 -04:00
Yaguo Zhou 6bdae93658 Add rabbitmq-server for platform:rpm into bindep.txt
It lacks rabbitmq-server dependency under plateform:rpm

Change-Id: Ia060a13dede0183e9340b9f2913a9475a97a0398
2018-02-16 17:29:15 +08:00
Zuul 63775d9e97 Merge "Provide bindep_profile in openstack-tox job setup" 2017-12-11 09:39:31 +00:00
Andrew Smith 0ca9567c4a Provide bindep_profile in openstack-tox job setup
Oslo.messaging uses a single bindep.txt to define common
and driver dependencies. The bindep_profile is used by the
bindep role to select the driver specific packages.

This patch:
* Add bindep_profile var to jobs
* Add kafka dependencies
* update test-setup for use by amqp1

Depends-On: I6beb7b07a7dbc345e63e758ebbc86400e0ee16d3
Change-Id: Ib552152e841a9fc0bffdcb7c3f7bc75613d0ed62
2017-11-29 11:10:35 -05:00
Kenneth Giusti d0a3f70966 Add zmq packages that are no longer in bindep-fallback
Change-Id: Id47e3097dd7ea3ad9dc9e9f73bce829d6a705b6e
Needed-By: Iab9495bd381b135e8a0f2e8f35e51a9218cf8f40
2017-11-28 14:57:48 -05:00
Kenneth Giusti e1a3da9443 Move legacy zuulv3 tests into oslo.messaging repo
Next step will be to re-write these for zuulv3

Change-Id: I2f6a8432e037f75d6abee3bc977933a310a4a2c7
2017-10-17 16:01:29 -04:00
Mehdi Abaakouk 8d2331a3b7 tox: rename zeromq target
The current zeromq target name are too long and reach the limitation
of 127 chars of the sheband of the virtualenv binary.

A target name must not be more than 22 chars to run in gate with
the tox job template.

This renames them to a shorter one.

It also creates aliases for the legacy jobs that we will remove
when the tox jobs are ready.

Change-Id: I5cbc368e7ea252f8c0c949c8e7ee3a70a560db22
2017-01-02 11:34:02 +01:00
Kenneth Giusti 2a9094af5d [AMQP 1.0] Setup the amqp1 test environment on ubuntu
Fixes the amqp1 functional tests so they can be run on Xenial.

Closes-Bug: 1643644
Change-Id: I3e3ee6779a60774ebffc1f45ae5564db934f8eaf
2016-12-19 14:47:04 -05:00
Mehdi Abaakouk 5fc28ec9cf Add bindep.txt/test-setup.sh to prepare the system
Change-Id: I9ac3132c082a31020dc2bf2a778fb5c4c0836c4c
2016-12-07 09:29:29 +01:00