Commit Graph

57 Commits

Author SHA1 Message Date
OpenDev Sysadmins a8450eb2d8 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:39:22 +00:00
Nguyen Hai c41c95b493 import zuul job settings from project-config
This is a mechanically generated patch to complete step 1 of moving
the zuul job settings out of project-config and into each project
repository.

Because there will be a separate patch on each branch, the branch
specifiers for branch-specific jobs have been removed.

Because this patch is generated by a script, there may be some
cosmetic changes to the layout of the YAML file(s) as the contents are
normalized.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: Iae87fbc18b7b14bca10e043b5438892259f5fc3c
Story: #2002586
Task: #24291
2018-08-17 14:47:44 +09:00
Jenkins 98ac0131cf Merge "add api unit test" 2017-09-15 01:25:09 +00:00
zhuli 2a71b8efe6 add api unit test
add api unit test to validate the accelerator_post function.

1. load a test app for pecan framework test
2. mock out the accelerator_create function in Conductor RPCAPI
3. post test request to '/accelerators' endpoint
4. do the check between request and response

Change-Id: I5d565d0d7ed56c27555666e52e34f5fd67005dcf
2017-09-14 13:56:59 +08:00
Jenkins a4640d7fd4 Merge "Add devstack plugin for Cyborg" 2017-09-13 17:19:12 +00:00
zhipengh 5ee1144e75 Pike doc clean up
Several clean up performed in this patch:

* remove readme in the doc/source
* move installation.rst and usage.rst to the new userdoc/
* add api.rst to userdoc/
* add introduction.rst in doc/source
* add index.rst in every folder
* add release info in every spec

Change-Id: I9ea96993f916b753cc1aa16c2ea2983b93922f23
Signed-off-by: zhipengh <huangzhipeng@huawei.com>
2017-09-13 10:51:11 -06:00
Jenkins 10392352f2 Merge "Update and replace http with https for doc links in cyborg" 2017-09-13 15:59:20 +00:00
shangxiaobj f454e41bf6 Update and replace http with https for doc links in cyborg
1) Update doc links according to OpenStack document migration
2) Use https instead of http for docs links

Change-Id: I5644f38cf56f1e3b6a31252523a3bf28248e9f08
2017-09-12 22:46:46 -07:00
Rushil Chugh d69a11bb4c Add devstack plugin for Cyborg
Change-Id: Ie6c5ca4b995bbdaa97c963cb7d1e0ba3f4e290ee
2017-09-12 22:43:47 -06:00
Jenkins 4e45b8624e Merge "add authtoken-middleware" 2017-09-13 04:08:05 +00:00
zhuli ee48522720 add authtoken-middleware
Add authtoken middleware for integrating with the OpenStack Identity API
and handling authorization enforcement based upon the data within the
OpenStack Identity tokens

Change-Id: I8056d69657d0a98b4446a494877f7b965ceb786f
2017-09-13 09:48:01 +08:00
Jenkins c5e5fb5ddf Merge "Add Release Notes and Architecture Docs" 2017-09-12 23:39:10 +00:00
Jenkins 396e73b291 Merge "Update contributing guide" 2017-09-12 23:18:51 +00:00
Jenkins ced6ce1072 Merge "Updated Hacking doc" 2017-09-12 23:11:18 +00:00
zhipengh 5ec3ce69a3 Add Release Notes and Architecture Docs
Add release note for Pike and architecture documentation
and diagram.

Change-Id: Ia5756ed7acf176f3910dfe2436da8186467377c8
Signed-off-by: zhipengh <huangzhipeng@huawei.com>
2017-09-12 15:42:40 -06:00
Rushil Chugh 621c25d248 Update contributing guide
Derived from Browbeat credit leifmadsen

af1ee36acc

Change-Id: I47a607fe976898e38f230a5fbf2692bd67720a2f
2017-09-12 21:10:05 +00:00
jkilpatr 589cd464cf Updated Hacking doc
Change-Id: I9e21a75a4d004661caddffb6ac394c6aa8c2f6e5
2017-09-12 15:06:29 -06:00
Rushil Chugh 7613ec7e2b Replace all occurences of Nomad with Cyborg
This patch proposes to replace all occurences of
Nomad with Cyborg.

Change-Id: I48a5fc13fd8faa682736d44e6c8cd96eeedaf2e3
2017-09-12 15:06:09 -06:00
Jenkins 168ea97459 Merge "Cyborg deployment script" 2017-09-11 19:27:17 +00:00
Jenkins cbe27fc8eb Merge "add policy support" 2017-09-11 16:51:55 +00:00
Yaguo Zhou 2b4053519f Replace DbMigrationError with DBMigrationError
because DbMigrationError is deprecated

Change-Id: I69e208297a764b53fcf0496964ebae9112eeb905
2017-09-05 22:55:46 +08:00
zhuli c6c5ca042f add policy support
Add policy support to determine which user can access which objects
in which way

Change-Id: If959089366ec252d4a7904d0e78733a2bf52fff5
2017-09-03 21:04:20 +08:00
jkilpatr 85ac496ff6 Cyborg deployment script
This deploys cyborg services across various hosts and sets them up
as boot time services configured to access the local rabbit and mysql
instances and then runs some validations to ensure
that everything started correctly.

This does not have any saftey for multi-controller setups yet, right now
if you hand the playbook 3 hosts under 'controller' it will deploy three
api endpoints and three agents. Which probably won't work right.

Change-Id: I79b6b1ce9bb6766d5e608c89504c4bbaeaba5599
2017-08-30 09:27:56 -04:00
jkilpatr 4f5c85e654 Modify tox.ini to reflect patch tests
So right now flake8 is in our tox.ini but not in the upstream
infra config. Meaning if you run tox locally with the hope of
finding and fixing linter errors in your patch you get about
100 lines of docstring errors that aren't actually enforced
when you upload your patch to gerrit. We need to either chose
to enforce those rules on gerrit (and write a lot of docstrings)
or change the tox.ini to reflect the actual gates better so that
we can more easily debug locally.

Change-Id: Id0456f53d176eb1d13c3bc22ef43b62772a86b89
2017-08-24 08:23:16 -04:00
zhuli 57e4c042ca add cyborg-conductor & db
1. add conductor rpc
2. add cyborg-conductor command
3. add db and init `accelerators` table
4. add accelerator_create method
5. add cyborg-dbsync command

Change-Id: I07333a4df7a42878dcf950b2b7893a37670da87b
2017-08-21 09:25:48 +08:00
Jenkins 55e0b2bcb7 Merge "add cyborg-api v1 & hooks" 2017-08-18 14:36:59 +00:00
Jenkins 3f86eca05b Merge "Updating the link of docs,bugs,bps in README.rst" 2017-08-17 08:19:25 +00:00
zhuli 2dd193ae5c add cyborg-api v1 & hooks
add these for further expansion:
1. give an initial version of v1 to api service,
2. add Config and PublicUrl hook to app.
3. add resource endpoint in response body.

Change-Id: I2b84508a07bbbf0f5133c828a8217a23398564db
2017-08-17 09:03:27 +08:00
00129207 74c0bcaf7b Rename nomad to cyborg
Change-Id: I1710663f2d52f6eb820378e8d6c57c918198c4af
2017-08-15 16:22:05 +08:00
00129207 de199a3e92 Updating the link of docs,bugs,bps in README.rst
Change-Id: Icb05b12b2e32d0e6e056c09dad83ee1be10f35ba
2017-08-15 13:35:01 +08:00
Jenkins 005273fce4 Merge "Database interface using sqlalchemy" 2017-08-09 19:06:13 +00:00
jkilpatr 6fcf94b969 Database interface using sqlalchemy
This commit adds sqlalchemy as a database backend, the database connection
url is loaded from the config file in the same format as any other service.

The accelerator class has been given tags that allow sqlalchemy to map it to
a table in the database and perform saving out/queries automatically.

For further work I'll want either an api or a driver to start integrating with
don't want to get too deep into buisness logic before we know exactly what those
will look like.

Change-Id: I6a9712de0b4f985bab80178845f59e10c05032a5
2017-08-07 15:28:42 +00:00
zhuli c7b24fda7f Add cyborg-api command
Change-Id: I392ad0383d5d8299db407df79bd60adbfbd428cd
2017-07-29 04:01:06 -04:00
Jenkins 9fa1a7183c Merge "Add Pecan/WSME framework for API" 2017-07-28 15:28:03 +00:00
zhuli 1861b88138 Add Pecan/WSME framework for API
Change-Id: I4a411c4f2af1b659c3d1a51b69045524842c236b
2017-07-21 10:00:04 +08:00
Rushil Chugh df8671c65a Create driver directories and prototype generic driver
Change-Id: I595d6b969acd53ecae3d28cec22fe152ca5d5ff7
2017-07-20 14:21:24 -04:00
Jenkins 8584b50f60 Merge "Removed older version of python added 3.5" 2017-07-19 17:09:49 +00:00
jkilpatr 0cbb31f02c Cyborg Conductor Stubs
This is a set of stubs for the Cyborg conductor with working
rpc and message handling although nothing really
to do with those messages until the DB component is formalized
and created in the next patch.

Change-Id: I0df68a165881697c7b199189a89471baf9ece2af
2017-07-17 08:18:52 -04:00
Jenkins dad0795e7b Merge "Agent Stubs" 2017-07-14 18:26:05 +00:00
Arundhati Surpur 8c559f6c3b Removed older version of python added 3.5
In setup.cfg file the python 3.5 is added
In tox.ini the python 3.5 is added

Change-Id: Ifd063c95b0a4daed589805b1363f39ff89d7def8
2017-07-06 11:30:48 +05:30
zhipengh b8669f18e6 Initial cyborg api and db design proposal
This spec proposes the initial design for the
cyborg api. The cyborg api should support the basic
operations concerning accelerators, and does not
necessarily have to be user facing api at the early
stage.The api should support functionalities such as
provision, attach, detach, list and update.

This spec also contains the proposal for a simple DB for
Cyborg. Note that although we propose a DB schema for Cyborg,
in implementation it should be aligned with resource provider
db schema as much as possible.

APIImpact

Change-Id: I98c74df91f4548ecef42d2e3f96facf9023a346a
Signed-off-by: zhipengh <huangzhipeng@huawei.com>
2017-06-28 14:27:28 +00:00
Jenkins 2b01cb135a Merge "Accelerator class for internal representation" 2017-06-27 23:33:57 +00:00
jkilpatr 39db6fae39 Agent Stubs
So I think this has the most functionality we can expect of a stub
at this point, it accepts a configured transport URL and node id
then takes rpc commands to modify the state of the agent.

What needs to be added is a accelerator handler class that runs
in the main loop to perform the various ongoing tasks of the Agent
but I can't really write that until I have a driver to link against.

Change-Id: I35438c01ca2765ca3dd2575bf2fac63099a30d29
2017-06-27 12:41:03 +00:00
jkilpatr cd99cfe434 Accelerator class for internal representation
Since I want this to be a common class shared between each
component I split it out into it's own commit to be merged
in stub form so that we can each rebase on it and extend
with our own functions/properties as required.

Change-Id: I0f396afcc4c4ae38183ce85414ba3d8741279103
2017-06-20 14:47:10 -04:00
nizam b51ceed294 Drop MANIFEST.in - it's not needed by pbr
cyborg already uses PBR:-
setuptools.setup
    (setup_requires=['pbr>'],
    pbr=True)

Change-Id: I656c0bd402b79541dd3b008821eab9c2e4c8e385
2017-06-16 20:04:21 +05:30
nizam 40f790bc35 Don't include openstack/common in flake8 exclude list
The directory openstack/common was used to keep codes from oslo-incubator,
we have retired oslo-incubator,so don't use this directory any more.

Change-Id: I288970e37f67c8bdf5da172f55919700fd5ee134
2017-06-16 20:00:14 +05:30
jkilpatr 90799f60c8 Add basic gitignore file
I figured I should break this out of my conductor commit
to merge on it's own sooner.

Change-Id: I839285f7c88e4a1a935b76c7ad8446d4a2fc4389
2017-06-09 08:58:05 -04:00
Rushil Chugh 467e03df3c Add spec for Cyborg generic driver implementation
This spec proposes to add a generic driver implementation
for OpenStack Cyborg.

Change-Id: I701b70d3b6abf220ac5b834aad26b36cd2476632
2017-05-24 15:41:08 +00:00
Jenkins 2159a6f530 Merge "Conductor spec" 2017-05-24 15:17:18 +00:00
jkilpatr 0be38ed1cb Cyborg Agent Spec
Cyborg Agent resides on various compute hosts and monitors them for accelerators.
If an accelerator is present but not setup Cyborg Agent will notify the operator
that intervention is required. If the accelerators are prepared for use Cyborg
Agent will begin monitoring their status and reporting it to Cyborg Conductor
which will manage use this information to assist with scheduling and operation.

Change-Id: I9596297b8fc64571035d800a24c3e54142dfb0e2
2017-05-18 15:35:29 +00:00