Commit Graph

3136 Commits

Author SHA1 Message Date
Andreas Jaeger e61cc055ab Retire repository
Fuel (from openstack namespace) and fuel-ccp (in x namespace)
repositories are unused and ready to retire.

This change removes all content from the repository and adds the usual
README file to point out that the repository is retired following the
process from
https://docs.openstack.org/infra/manual/drivers.html#retiring-a-project

See also
http://lists.openstack.org/pipermail/openstack-discuss/2019-December/011647.html

Depends-On: https://review.opendev.org/699362
Change-Id: I10917e42829b459c41ca46514faa72fc46abf7be
2019-12-18 09:52:23 +01:00
Dmitry Guryanov 392f3859ff Calculation of interface types from templates fixed
In case of adding port on bond 'ether' type was set
for interface. This was root cause of the issue -
bond was processed as nic.

Closes-Bug: #1602817
Change-Id: I6a5136ce9ce5398aa6d55c795857769a7a41f7b0
2017-05-10 09:09:45 +03:00
Georgy Kibardin b8e2606daf Override keys() with a function, not an attribute
By mistake keys function has been overriden by a value.

Change-Id: I713bddcfb66c4835d477972ece7e0983d263377f
Closes-Bug: #1666913
2017-04-10 13:44:47 +03:00
Vasyl Saienko 9dabe06369 Add Ironic multitenancy support
This patch adds support to deploy Ironic with separate Neutron network
for provisioning baremetal instances.

  * Add NetworkDeploymentSerializer100 as Ironic multitenancy is supported
    from Newton, and we will backport this till stable/newton.
  * Update network scheme generation to create 'vlan' baremetal network,
    assign IPs to Ironic conductors from this network, make them
    accessible from baremetal servers.
  * Add new checkbox at 'Openstack Settings/Additional components' tab
    which allows to define if separate provisioning network should be used
    during deployment. This is a trigger to switch ironic deployment to
    multitenancy case. If not selected old behaviour is kept, 'flat'
    network is used. The checkbox is shown only when Ironic component is
    enabled.

Change-Id: I861a8b3b046202526d6a856c9f2dca2cfaddc887
Related-Bug: #1588380
2017-03-31 10:21:34 +03:00
Jenkins aa6f282343 Merge "Reorder configs_query by time" 2017-03-28 13:29:33 +00:00
Alexander Kislitsky 4fa861fa8a Distributed serialization implementation
Distributed serialization is implemented with python distributed
library. We have scheduler for jobs management and workers for
jobs processing. Scheduler is started on the master node as well
as set of workers on it. Also workers are started on all nodes.
In the cluster settings we can select the type of serialization
and nodes statuses that allows serialization on it. By default
nodes with status 'ready' are excluded from the workers list.

For data serialization we are using only nodes from the cluster
where serialization is performing.

Before the computation fresh nailgun code is sent to the workers
as zip file and it will be imported for job execution. So we always
have fresh nailgun code on the workers.

In one job we are processing chunks of tasks on the workers. This
approach significantly boosts performance. The tasks chunk size
is defined as settings.LCM_DS_TASKS_PER_JOB parameter.

For limiting memory consumption on the master node we use parameter
settings.LCM_DS_NODE_LOAD_COEFF for calculation max number of jobs
in the processing queue.

Synthetic tests of distributed serialization for 500 nodes with
nubmer of ifaces >= 5 performed on 40 cores (4 different machines)
took 6-7 minutes on average.

Change-Id: Id8ff8fada2f1ab036775fc01c78d91befdda9ea2
Implements: blueprint distributed-serialization
2017-03-24 15:15:30 +00:00
Jenkins 36b90eacdc Merge "Use tags instead of roles" 2017-03-24 11:48:45 +00:00
Jenkins 531e275d34 Merge "add removed handlers" 2017-03-23 13:18:50 +00:00
Igor Gajsin cb8529a84a add removed handlers
There were urls and handlers for vmware in the nailgun, that were
removed completely in
review.openstack.org/#/c/428402/15/nailgun/nailgun/api/v1/urls.py

The better approach is remain the urls and make special stub-handlers
instead of real ones.

Change-Id: I50bf740ec726c9cc57ff63d49aff718e812e6feb
Closes-Bug: #1668258
2017-03-23 12:26:38 +03:00
Jenkins 7aa506469b Merge "Use assertIsNone instead of assertEqual(None, obj)" 2017-03-22 17:23:16 +00:00
Georgy Kibardin fba3bc3445 Use tags instead of roles
Now the deployment behaviour is driven by tags rather than role names, i.e. role
name cannot be relied upon.

Change-Id: Icfabeeb0b7fb6a9d697a09c3cf1fa020bbd4c323
Closes-Bug: #1669743
2017-03-21 13:45:07 +03:00
Jenkins c45713ead3 Merge "add tests for alembic migration" 2017-03-20 15:13:13 +00:00
Igor Gajsin 8e12d76f86 Reorder configs_query by time
There is the possibility to change OpenStack config after deployment.
Changes could be applied per role. And in the case of multiple roles
on a node, many changes could pretend to be applied. I.e. if we have
a config for the role 'compute', a config for the role  'cinder' and
a node with role 'cinder+compute' we have to choose one of them.

Previous decision was 'sort it in the lexicographical order', so it
applies 'cinder' then --- 'compute'. It is contra intuitive. The best
option is applying to a node the last related config, to new config
overlaps old ones.

Change-Id: I7db388ca3baeb351adc9fdb70c55b0be50fafe48
Closes-bug: #1671521
2017-03-20 16:51:39 +03:00
Igor Gajsin a8ac320d8f add tests for alembic migration
There was the commit that removes vmware. It has alembic migrations,
but doesn't have any tests for that. This commit fixes that.

Change-Id: I66090b0a0d7bfbd8e2365ec027fabfefc9d612da
Closes-Bug: #1668249
2017-03-13 14:02:23 +03:00
Mikhail 9c51c8e22b Serialize mtu for dpdk interface with 'i40e' driver
On NIC: XL710 with driver 'i40e'  MTU does not take into
account 4 bytes VLAN tag, so we should increase it manually

DocImpact
Change-Id: I3d95db9ec6fae4d8cd397c429d785dbdf1502b21
Partial-Bug: #1587310
Co-Authored-By: Fedor Zhadaev <fzhadaev@mirantis.com>
2017-03-06 12:01:47 +00:00
Jenkins d72287f19e Merge "Fixed switch to deploying state for nodes which will not be deployed" 2017-02-28 21:33:49 +00:00
Jenkins 3448243ba3 Merge "remove vmware" 2017-02-21 13:06:39 +00:00
Igor Gajsin 634b66df45 remove vmware
VMware not supported since Fuel 10.

Implements: blueprint remove-vmware

Change-Id: Ia26a97d13bb9c3d2e838d639efdababbb15f86da
2017-02-14 15:52:27 +00:00
Dmitry Sutyagin 03aaca2dee Add limit, offset, order in collection GET
Allow limiting the number of objects returned via GET
by providing "limit"
Example: api/notifications?limit=5

Allow offseting (skipping N first records) via "offset"
Example: api/notifications?offset=100

Allow ordering of objects by providing "order_by"
Example: api/notifications?order_by=-id

Add helper functions/classes to:
- get HTTP parameters (limit, offset, order_by)
- get scoped collection query by applying 4 operations
  filter, order, offset, limit
- set Conent-Range header if scope limits are present

Make default NailgunCollection's GET utilize scoped query
This makes default (parent) GET of child handlers support paging
and ordering (overriden GET methods will not get this functionality
automatically)
NailgunCollection.GET is also an example of how to implement
this new functionality.

Helper functions/classes can be utilized in child handler methods
to implement filters / ordering / paging

Related-Bug: 1657348
Change-Id: I7760465f70b3f69791e7a0c558a26e8ba55c934a
2017-02-14 08:11:23 +00:00
Jenkins c77aa8923a Merge "Limit the minimal RAM amount for OVS+DPDK to 1024MB" 2017-02-13 12:25:55 +00:00
Jenkins 6c29488b0c Merge "Set nodes' statuses to 'error' when their nodegroup is deleted" 2017-02-09 11:17:07 +00:00
Bulat Gaifullin dc8fd092d3 Fixed switch to deploying state for nodes which will not be deployed
Nodes can be exluded from deployment, if there is no tasks to run on this nodes.
Such nodes should not be switched to deployment state.

Change-Id: I4cd23769b7643aae7b149ba30e5b0e91a3021563
2017-02-08 13:20:22 +00:00
Vladimir Kuklin cd2ee13830 Set nodes' statuses to 'error' when their nodegroup is deleted
According to the bug below and the spec, we did not implement
one multirack feature aspect.

https://specs.openstack.org/openstack/fuel-specs/specs/8.0/multi-rack-static.html#notifications-impact

Now we add resetting node to error to node group deletion callback and
send a notification.

Change-Id: I6b2bae5601ba7dbca620bb3861e95b0e554f8699
Closes-bug: #1644630
2017-02-07 17:44:06 +00:00
Anastasiya d2a5333e99 Limit the minimal RAM amount for OVS+DPDK to 1024MB
* min value was set in consts
* appropriate validator was added
* tests for validator were changed
* test for serializer were changed

Change-Id: Ib8ccb0658bd401ce492257f855013d1d7e0f2dac
Closes-Bug: #1653081
2017-02-07 16:42:01 +00:00
Alexander Kislitsky 71fb921dbe Handler for changing notifications statuses added
As workaround for decreasing loading in the UI on unread
notifications fetching we can mark all notifications as read.
For such purposes we add NotificationsMarkAllHandler

Change-Id: I2e6a0daaf8712ab3064df728a8fb463ef805aa06
Partial-Bug: #1657348
2017-02-07 16:39:05 +00:00
Jenkins 542b8558f2 Merge "Handler for counting notifications statuses added" 2017-01-31 11:36:39 +00:00
Alexander Kislitsky d4bf85957e Handler for counting notifications statuses added
For calculation of notifications statuses we made requests in the UI
and fetch all notifications data and process them on the UI side.
We want to replace a polling of the whole notification collection by
a polling of unread notifications number. This dramatically decrease
Fuel UI load in case of a big amount of notifications.

Change-Id: I8f83d4e2d7f58beaf06c489b2264ccb69f9927ce
Partial-Bug: #1657348
2017-01-30 18:03:15 +03:00
Alexander Kislitsky e46b57befc Message format on node(-s) deletion error changed
In case of already running task we are returning JSON instead
of plain text.

Change-Id: Ic3998b8e534b2fa67813faf033335e849abe55af
Closes-Bug: #1657350
2017-01-26 20:41:56 +03:00
Cuong Nguyen 5df1c9f08d Use assertIsNone instead of assertEqual(None, obj)
As stated by document [1], it's better to use assertIsNone instead of
assertEqual(None, obj)

[1]
http://docs.openstack.org/developer/hacking/#unit-tests-and-assertraises

Change-Id: I2dd12c4e5c31761e2069c96cf135a8d306d13cb8
2017-01-23 13:04:32 +07:00
Jenkins 0cabf795b5 Merge "Fix typo in sriov.numvfs 9.2 migration" 2017-01-19 15:04:18 +00:00
Julia Aranovich b315dda52e Fix typo in sriov.numvfs 9.2 migration
Closes-Bug: #1657709

Change-Id: I3297b62df1e887425e9940cc12807a4758423bfd
2017-01-19 11:38:42 +00:00
Anastasia Balobashina 092acaa562 Revert "Limit the minimal RAM amount for OVS+DPDK to 1024MB"
This reverts commit 6e4ef67269.

Change-Id: Ib9144e2becebfa9b4817e8389419892c0daadd35
Closes-Bug: #1656804
2017-01-19 12:54:31 +04:00
Anastasia Balobashina 75db9b9d2b Revert "Fixes for commit 6e4ef67269b849edb20e7ea9e73685a5cee0e6fc"
This reverts commit 763d5c25bc.

Change-Id: I6eea7fc85b6940109ed9cf3f3b97148b7bf90332
Partial-Bug: #1656804
2017-01-19 12:52:32 +04:00
Jenkins b697091131 Merge "Hide DPDK section if experimental is turned off" 2017-01-18 09:18:48 +00:00
Jenkins 8131924e6d Merge "Ensure that 'dpdk' in serialization before update" 2017-01-18 09:11:58 +00:00
Timur Nurlygayanov d1de5e7e79 Ensure that 'dpdk' in serialization before update
Change-Id: I8c14c25e08defc3c6533f7fbe7ba5f34120e098e
Closes-Bug: #1656783
2017-01-17 20:45:34 +04:00
Jenkins 3529f71f3b Merge "Serialization of OpenstackConfig configuration_options handled" 2017-01-17 14:45:07 +00:00
Alexey Shtokolov e8732127dd Hide DPDK section if experimental is turned off
Change-Id: I11bbfbdea3887104e4753716acac46b1668a754d
Closes-bug:#1655314
Co-Authored-By: Fedor Zhadaev <fzhadaev@mirantis.com>
2017-01-17 12:40:49 +00:00
Dmitry Ukov 54a13c6b97 Serialization of OpenstackConfig configuration_options handled
This is the first step for handling arbitrary data structures
in OpenstackConfig. At this moment we are handling explicit
serialization of the configuration_options.
The future steps are:

- changing configuration data format in the Fuel CLI
- data migration in the Fuel DB
- changing configuration data serialization in Fuel

The future steps are planned to be done for the Fuel 10 release

Change-Id: I6961e3d7a2bc5ae8b9c668c67a0ab5c23792f5b1
Co-Authored-By: Alexander Kislitsky <akislitsky@mirantis.com>
2017-01-17 10:59:35 +03:00
Fedor Zhadaev 2c9ab75d88 Make migration file for 9.2 consistent with openstack.yaml
Change-Id: Iaa93d5463952f0e4a0599fef8630ce9d47753ad6
Closes-bug: #1653061
Closes-bug: #1652076
2017-01-17 07:53:22 +00:00
Fedor Zhadaev e6300ed452 Revert "Make migration file for 9.2 consistent with openstack.yaml"
This reverts commit e0c836ceb9.

Change-Id: I925fc237d61fd95d5839a75810cac80bed4bb750
Closes-bug: #1656824
2017-01-16 14:44:21 +00:00
Fedor Zhadaev e0c836ceb9 Make migration file for 9.2 consistent with openstack.yaml
Change-Id: I9bcabbcdbb3f22422a709146303af57bd594bd79
Closes-bug: #1653061
2017-01-15 12:47:28 +04:00
Jenkins 18eaf8718d Merge "Fix naming of reset tasks and message duplication" 2017-01-13 11:19:20 +00:00
Jenkins 35112349c6 Merge "Serialize only active configs" 2017-01-13 08:51:26 +00:00
Jenkins 3c36a91d92 Merge "Tags info calculation is supported on plugins update" 2017-01-12 14:01:19 +00:00
Anastasiya 93f40003de Fix naming of reset tasks and message duplication
* reset_environment supertask contains 3 subtasks:
  base_reset_environment, remove_keys_task,
  remove_ironic_bootstrap_task
* names for tasks were changed
* response methods for remove_keys_task and
  remove_ironic_bootstrap_task were added to receiver
* _restore_pending_changes method was add only for
  reset_environment_resp
* migration for adding new transaction names and appropriate
  test were added
* test for check task message was added

Change-Id: Ib8a215174431486316bca533797932e02969c037
Closes-Bug: #1541868
2017-01-12 17:24:02 +04:00
Sergey Abramov 6266d27f15 Serialize only active configs
DeploymentLCMSerializer should return only active OpenstackConfigs

Change-Id: I2adee9e8a40f4295e807a5ff7a2e060793e55b24
Closes-bug: 1632235
2017-01-12 13:10:51 +00:00
Jenkins ccac8ae8ed Merge "Switch provider from ovs to dpdkovs" 2017-01-12 11:59:29 +00:00
Jenkins ead3c8e52a Merge "Conform tests to the 11/ocata release" 2017-01-12 11:59:22 +00:00
Jenkins 8d59ede22c Merge "Fixes for commit 6e4ef67269b849edb20e7ea9e73685a5cee0e6fc" 2017-01-12 11:38:51 +00:00