Commit Graph

56 Commits

Author SHA1 Message Date
Andreas Jaeger 32ca1f64ab Retire repository
Fuel (from openstack namespace) and fuel-ccp (in x namespace)
repositories are unused and ready to retire.

This change removes all content from the repository and adds the usual
README file to point out that the repository is retired following the
process from
https://docs.openstack.org/infra/manual/drivers.html#retiring-a-project

See also
http://lists.openstack.org/pipermail/openstack-discuss/2019-December/011647.html

Depends-On: https://review.opendev.org/699362
Change-Id: I274ce8f03b58ad770221219c197336055e263d38
2019-12-18 09:42:48 +01:00
Sergey Kulanov 3102e7fc29 Allow to pass RPM repos to build-sandbox
We need to have an abitily to pass some custom rpm repos into
rpm build-sandbox

Closes-bug: #1619309
Change-Id: Ie328e5b18c3a81f67b5d19ef0d3992594e7f58c6
2016-09-08 12:45:14 +03:00
Jenkins 14f2a3eb77 Merge "Reconfigure locales noninteractively" 2016-06-09 10:03:05 +00:00
Dmitry Teselkin 5b5f0f0b31 Reconfigure locales noninteractively
blueprint: mos-xenial

Change-Id: I9f90fcd8c1e76abfbac7b947c053e991780d304e
2016-06-06 19:37:23 +03:00
Dmitry Teselkin 139edb74aa [Typo] Use NEWLINE macros instead of newline
There is no 'newline' variable defined, but 'NEWLINE' is.

Change-Id: I48412b912df3715c515a7e356a0134b9644fa84e
2016-06-01 14:03:12 +00:00
Sergey Kulanov d27a808ad0 Get rid of Mirantis related links
All related internal mirrors can be re-defined through
the env variables, so we can freely remove them

Change-Id: Iae8bb0fbba8097e67287406a8aaf378283545c5c
Closes-bug: #1582701
2016-05-18 13:33:13 +03:00
Sergey Kulanov b9da983096 Suppress information requests during package configuration
Make debconf not interact with user

Change-Id: Iab73af702bff7b718559884b6aa7d0107c406cbb
Partial-bug: #1570333
2016-04-26 14:01:58 +03:00
Sergey Kulanov b8ca322f71 Disable yum verify SSL certificates/hosts at all
Disable SSL certificates check since we can have self signed
certs for yum repos

Change-Id: I38067ec3cf4e86b0b2623d716059763308ae0c5b
Closes-bug: #1541934
2016-04-01 11:59:32 +03:00
Sergey Kulanov 2e7b44e1d8 Clean Upstream CentOS repos which comes with centos-release pkg
We need to clean RPM chroot each time on installing packages from
$(SANDBOX_PACKAGES), since some of them can "bring" centos-release
as dependency

Change-Id: I274f3e3675d327c700262058682200d7781ff1b9
Related-bug: #1541871
2016-02-10 11:41:05 +02:00
Sergey Kulanov 135894c9f3 Remove CentOS upstream repos from rpm sandbox
We need to remove CentOS upstream sandbox repos, which comes with
centos-release package before any yum operations.

Change-Id: I6322ab90c6aca744820446021432a78a2ba5f37a
Closes-bug: #1541871
2016-02-04 16:38:43 +02:00
Dmitry Teselkin 5b0bb0a2c3 Do not create TEMP directory
Env var $TEMP is not set anywhere, and always empty.
There is no point to run 'mkdir $TEMP'.

Change-Id: I04345d8431dca0b703e0edaf00aee168df8acc3c
Related-Bug: #1522909
2015-12-22 14:34:52 +03:00
Jenkins f3f9f24cb4 Merge "Revert "Remove ubuntu proposed channel"" 2015-12-09 10:24:40 +00:00
Sergey Kulanov 9b50139230 Use yum-builddep from chroot but not from build host
Start using yum-builddep from chroot:
1. Prepare chroot from upstream mirrors only for installing yum inside it
2. Update yum.conf with mos mirrors with path related to chroot
3. Mount local_mirror into chroot
4. Use all yum stuff from chroot

Closes-bug: #1522607

Change-Id: Ifd9d7c6a35c4977e78eba10ffcd0b1a8dcfee4ca
2015-12-07 09:24:04 +00:00
Vladimir Kozhukalov bda3b5fafa Revert "Remove ubuntu proposed channel"
This reverts commit b38fb5732d.

Change-Id: Ie973d36311a3ce8e9f3757547086db3b23a2f57c
2015-12-05 21:15:47 +00:00
Dmitry Teselkin b38fb5732d Remove ubuntu proposed channel
Change-Id: I32996cdf1a5899b84c57b65e95dcb8acf7ecc582
2015-12-05 19:38:31 +03:00
Dmitry Teselkin 4853b7da21 Fix ISO build process for CentOS7
Existing ISO build scripts can't build CentOS7 based
ISO due to changes in package names, files, and so on.

This review fixes issue have been found, and introduces
several minor improvements.

Blueprint: master-on-centos7

Breaks: centos6

Co-Authored-By: Ivan Suzdal <isuzdal@mirantis.com>

Change-Id: I830ff03aa1051f14f2bdafb16cca1979d38e9ad5
2015-12-04 01:30:17 +03:00
Roman Vyalov 9ddefc6327 Revert "Revert "Separate CentOS from MOS""
Fix the problem with separate repos to support rebuild docker

1. Make a symlink for mos-centos in /var/www/nailgun in iso/ks.template
2. Add mos-repos to the bootstrap_admin_node.sh

This reverts commit 32b1363015.

Closes-bug: #1521551
Change-Id: I8ef58b581f253b26d158b725a9e366d7f1b3706d
2015-12-01 12:44:59 +00:00
Matthew Mosesohn 32b1363015 Revert "Separate CentOS from MOS"
The commit this patch reverts breaks Fuel CI
on docker container rebuilds.

This reverts commit bc9c3117c7.

Change-Id: I18fe16cf8f0be40e30fec6229606d1d69cbfe73d
Closes-Bug: #1521551
2015-12-01 10:52:53 +00:00
Vitaly Parakhin bc9c3117c7 Separate CentOS from MOS
Release ISO must contain only packages that are
modified by MOS team, and CentOS upstream packages
for Fuel node deployment.

MOS repo, as well as the ones specified in the
EXTRA_RPM_REPOS variable, are downloaded and
placed on the ISO as-is.

Blueprint: separate-mos-from-centos

Change-Id: I983f37371a70d2901bdf0ebef122ba1a2f2e44b9
2015-11-24 13:22:10 +02:00
Vladimir Kozhukalov 39990f503d Install rpm packages one by one using xargs and yum
The thing is that when using 'yum install package1 package2'
yum is not going to fail if one of the packages fails to
install. Instead we use 'echo package1 package2 | xargs -n1 yum install'
to install them in turn.

Change-Id: I878d6c2589636aa39495c0fefc0c1dc9f1b33a56
Closes-Bug: #1465388
2015-09-21 18:30:11 +03:00
Vladimir Kozhukalov fa08b52fbd Switch to perestroika v5 repositories
Perestroika builds both rpm and deb fuel repos.
We use perestroika rpm repository to build fwm
repository which includes fuel packages as well
as those packages which are listed in requirements-rpm.txt.
Deb repository can be used directly.

Closes-Bug: #1479761
Change-Id: I236144759eb38e71977d175226f81772d23de9b3
2015-08-10 14:33:16 +00:00
Jenkins 826387d1a0 Merge "Update Fuel master node build system to 6.6 mirrors with updates." 2015-08-10 12:20:40 +00:00
Sergey Kulanov b87de67f15 Create targets to show repos configuration during ISO build
We can talk about several types of repos configurations:
 * Ubuntu sandbox (make show-ubuntu-sandbox-repos);
 * CentOS:
      - for building local mirror (make show-yum-repos-centos);
      - for using in sandbox (make show-centos-sandbox-repos);

This patch introduces several changes
1. Rename show-apt-source-list target to show-ubuntu-sandbox-repos
   to be closer to centos naming (show-centos-sandbox-repos)
2. Add show-centos-sandbox-repos target, which will show yum
   configuration for centos sandbox
3. Add show-yum-repos-centos, which will show yum configuration
  used while building local centos mirror

Examples:
   -  make show-ubuntu-sandbox-repos
   -  make show-centos-sandbox-repos
   -  USE_MIRROR=none \
       EXTRA_RPM_REPOS=extra,http://my.repo \
       make show-yum-repos-centos

Change-Id: I0b1141f8b7acfa682f7d4c4cc6e2fd09363eb3ca
2015-08-10 11:49:30 +03:00
Sergey Kulanov 64c896f2a5 Allow to print ubuntu sandbox repos list and pinning rules
Add target to get the content of files from ubuntu sandbox:
- source.list (repos)
- preferences (pinning)

Change-Id: I918516857753c5caca48c4c9f71866df817fde1d
2015-08-06 17:03:58 +03:00
alexz 858a4ee833 sandbox.mk : Custom https\ssl cert
Copying local certificates and CA to chroot
Useful in  case deb repositories behind https

Change-Id: I44fe3126cb5a817dc317afbe7c56d37e61dac392
Partial-Bug:#1420793
2015-08-05 17:20:46 +00:00
Aleksandr Mogylchenko bd640f231c Update Fuel master node build system to 6.6 mirrors with updates.
This also requires swapping priorities for Mirantis and upstream
repos, to ensure that packages will be actually updated.

Related-Bug: #1476245
Change-Id: I7509ecca711737ab7a307dc573bf99c71fa62a21
2015-08-05 12:57:57 +00:00
Sergey Kulanov dab18cb576 Work around broken MOS 7.0 APT mirrors structure for staging mirrors
Change-Id: I8a50e3e3b5f4890f2ca8f9558d90adcf0a3f34f3
2015-07-22 14:14:28 +00:00
Alexei Sheplyakov 99795b21b9 Make SANDBOX_UBUNTU more robust
- Make SANDBOX_UBUNTU fail if something goes wrong to prevent it from
  producing a broken chroot,
- Suppress package configuration dialogs so they don't block the build,
- Quite of postinst scripts rely on /proc. Mount /proc in the chroot
  to make those packages happy.

Depends-On: I37e20b4e022ddbf946cf3b161416e1ab24e36fb3
Change-Id: I275c82ccec08f0f34d7280089a59091ce1cbfa68
2015-07-21 22:26:19 +03:00
Sergey Kulanov 3673b85fd6 SANDBOX: work around broken MOS 7.0 APT mirrors structure
This patch should be reverted after fixing the (APT) repositories.

Change-Id: I37e20b4e022ddbf946cf3b161416e1ab24e36fb3
2015-07-21 19:42:39 +03:00
Jenkins b8c87c9560 Merge "SANDBOX: copy /etc/hosts to the staging chroot" 2015-07-21 13:03:12 +00:00
Alexei Sheplyakov 94fe76d476 SANDBOX_UBUNTU: fix APT pinning rules
The (APT) repo @ mirror.fuel-infra.org has Codename=mos6.1 instead of 'trusty',
and the repo @ obs has Codename='trusty'. SANDBOX_UBUNTU should work with
both variants.

blueprint fuel-bootstrap-on-ubuntu

Change-Id: Ia249bab2012c83e836b3d43eaf5b7293dd146d9a
2015-07-20 09:59:38 +03:00
Alexei Sheplyakov cb06f633b4 SANDBOX: copy /etc/hosts to the staging chroot
Allows people with weird setups (no DNS) to build the ISO. Having
the build system resolv.conf and hosts in the produced chroot might
be a wrong thing, so backup the original /etc/hosts (and resolv.conf)
so it's possible to restore them should that be necessary.

Closes-Bug: #1471155
Change-Id: I8a8b1305c9419d7bcddb1272e01c9c9eaf08716c
2015-07-04 12:07:36 +03:00
Alexei Sheplyakov bd108b9a96 packages/deb: suppress starting services in the chroot
debootstrap removes /usr/sbin/policy-rc.d, so it should be created
once more. Prevents failures like
http://jenkins-product.srt.mirantis.net:8080/view/custom_iso/job/custom_6.1_iso/1285/consoleText

Closes-Bug: #1459612
Change-Id: Id0f38da26e419a6bb4ca3f9749c71563d4023c8d
2015-05-28 13:43:29 +03:00
Sergey Kulanov 5c24590f39 Install priority pluging in rpm SANDBOX
Since we are using several repos with priorities in rpm SANDBOX,
we need to have this plugin inside it

Change-Id: Ib07ea4902e8e69ba2b05adfd197b9e24ef3e9c66
Implements blueprint: package-fuel-components
2015-05-07 10:47:33 +00:00
Vladimir Kuklin 046db2b158 Set MIRROR_UBUNTU suffix correctly for staging mirrors build
Change-Id: I7f546ebb7a0acfca72587822bf726d463d53d26c
Closes-bug: #1447231
2015-04-23 16:03:18 +03:00
Vladimir Kuklin b715f0b397 Refactor how we are doing packaging
This commit is a squashed version of commits that
implement packaging of fuel components. In order to
make our packaging process better I had to introduce
some new macros and do additional cleanup.

The main paradigm that we are following with this commit is
the following:

1 GIT REPO -> 1 PACKAGING SPEC -> N PACKAGES

Though it would be ideal to have only one package per git repo,
but this is left for further releases

This change is very essential to make updates process easier
as we provide only one type of artifacts that a user can fetch -
distro-specific package

This particular commit does not introduce new DEB packages
(such as packages of OCF scripts and other binaries that
we currently put onto the slave nodes with puppet instead of
installing them as packages) which will be introduced as
a part of whole packaging initiative a little bit later

1) Add prepare_git_source macro
This change is important to always
checkout the code from git working
or we can end up with garbage getting
into package source code and add
version.txt file to source archives

2) Remove nailgun-redhat-license package
This package is obsolete - we do not need
it.

3) Package fuel-library into RPM package

4) Delete old packages and misc stuff

This change is a little cleanup of python-tasklib
and other leftovers

5) Change RPM sandbox configuration

Change RPM sandbox configuration to use upstream mirrors
to be able to install nailgun build dependencies

6) Alter Nailgun spec

a) Change nailgun spec to use NPM during package
build
b) Switch nailgun to prepare_git_source
c) Package all packages of fuel-web repo using
only nailgun.spec

7) Alter RPM sandbox preparation to install build-deps

8) Package astute and mcagents using astute.spec

9) Include all built RPMs

Include all RPMS that were built inside the sandbox

10) Package fuel-ostf with git-archive

11) Build python-fuelclient using git_archive macro

12) Move specs to particular git repositories

13) Rename fuel-library and ostf to make macros easier
14)Adjust build scripts to fetch specs from particular
fuel repositories

FUEL DEB-packaging related code

15) Restore part of make system code for DEB packages building

16) Nailgun debian spec files for all nailgun-based packages

17) Clean up SANDBOX for Ubuntu generation

18) Clean up some package building scripts

19) Put PACKAGE_VERSION variable into the top config.mk

20) Add dockerctl and change fuel-library tar.tg path

21) Move deb rules to particula repos

22) Allow to rebuild deb repo with reprepro on-the-fly

24) Fix repocleanup stanza to parse source packages metadata

25) Debmirror whole repos in order not to break reprepro

26) Make docker image build depend on late RPM packages
or it may lead to race conditions

27) Clean up old deb packages with one shot instead
of parallel run

Change-Id: I15ae4d0abe51c72b28793e1a1ef30fec0f668b73
Blueprint: package-fuel-components
2015-04-20 18:21:57 +03:00
Vitaly Parakhin 7177b8fcb3 Separate MOS Ubuntu from upstream
1) Change mirroring procedure for Ubuntu:

   - USE_MIRROR=none: rsync the whole mirror from build server
   - USE_MIRROR=<location>: mirror only required MOS distro

Added support for different mirroring methods.

2) Remove procedure of building Fuel deb packages
3) Remove building of deb-based IBP images
4) Remove deb-based chroots
5) Modify creation of Ubuntu diff mirror artifact

Implements: separate-mos-from-linux
Change-Id: Icd10aea6ebddb27976e88ceb930be9afac0241ad
2015-03-24 14:14:06 +02:00
Alexei Sheplyakov 6cb3c47e0a packages/rpm: speed up the build
Create the standard build chroot (as a tarball) and use it instead of
bootstrapping from the scratch.

Change-Id: I55d7d3f36b50ca4d96dfb7c73790dc8256078855
2015-02-06 11:30:58 +03:00
Alexei Sheplyakov 1784280ee4 packages/deb: speed up the build
Create a tarball of a base system + build-essential packages, and use that
for building the packages instead of bootstrapping Ubuntu from the scratch
for every package.

Change-Id: I91a1aa326fc8de51e1e5305fbe8b9dd3ae6c226e
2015-01-16 19:17:17 +03:00
Alexei Sheplyakov be1e0a689f packages/deb: disable starting services in the staging chroots
Without this patch a copy of udevd gets started in the staging chroot (where
the Debian packages are built), and that udevd process starts hogging CPU
after the chroot gets removed. To solve the problem prevent services from
being started in the staging chroot.

blueprint support-ubuntu-trusty

Change-Id: I7f213a0299752a7b85feeccb21a61603538caee7
2015-01-02 18:39:51 +03:00
Alexei Sheplyakov a1c07e3cbb packages/deb: build packages using the correct mirror (LP #1390416)
As of now Fuel related deb packages are built using the upstream mirror.
This yeilds inconsistent dependencies, for instance, packages depend on
both the upstream and the customized python versions, and provisioning of
Ubuntu node fails as a result.

To resolve the problem setup the build chroot using the official Fuel apt
repo. While at it use the locally created apt mirror instead of downloading
packages once more, and fix a number of inconsistencies/bugs.

* sandbox.mk:
  - sandbox define is modified so as to use local pre-built mirror.

* packages/deb/module.mk:
  - use the helper script to create build sandbox.

* requirements-deb.txt:
  - make sure tools required for building Debian packages are included
    into the local apt repo.

Change-Id: I9f7b06bba94a65b2d65168cc1122257f4bec78be
Related-bug: #1390416
2014-11-14 18:24:15 +03:00
Vitaly Parakhin 967ec61eb6 Add building of Fuel deb packages during ISO build.
1) Add routines for building deb packages and adding them to local mirror.
2) Add commands for creating Ubuntu-based build sandbox.
3) Update deb specs for Fuel components.

Closes-Bug: 1373400
Change-Id: If098654d1158aca6676f9cbb3fc3100fc2e8674d
2014-10-17 16:16:41 +03:00
Dmitry Pyzhov a53a007a36 Makesystem target for astute rpm package
blueprint pack-all-eggs-and-gems
Related-Bug: #1312130
Change-Id: I516e6806a458de8f63bf9f2718533d4ee6741c99
2014-04-24 15:40:30 +04:00
Dmitry Pyzhov 1f1f5138e2 Fix iso build
Change-Id: I7e6375fbb7948c459013f2aa30d50a66e90b2b4f
2014-04-23 20:26:37 +04:00
Vladimir Sharshov 4471a16761 Use a new ruby 2.1 in the master node as a single ruby version
* remove unused gems;
* remove rbenv env;
* remove ruby compilation;
* use ruby 2.1 for master node.

TODO:
* remove raemon;
* remove build gems for Astute;
* update spec for Astute.

Change-Id: I099e65901ef3cf691f90d5bda4dd2f1a5cb76ea7
Implements: blueprint fuel-new-system-ruby-in-master-node
2014-04-08 11:47:00 +04:00
Dmitry Pyzhov 98fb28bbdf Use 3.10 kernel in bootstrap
Change-Id: Ic695007fb459f1c19f6c530b5edf47c87d1b6510
Closes-bug: #1291424
2014-03-25 14:00:23 +04:00
Dmitry Pyzhov b5d17a9324 Fuel-2.2 2013-05-24 15:58:49 +00:00
Dmitry Pyzhov fee0eea547 Makesystem fixes:
Fix SOURCE_DIR, BUILD_DIR and LOCAL_MIRROR variables;
  Remove outdated files;
  Split chroot packages target
2013-04-23 20:36:02 +00:00
Alexander Pavlenko 8c730e56f5 add MCollective and Raemon to the build 2013-04-11 13:54:41 +04:00
Alexander Pavlenko dc1cdef954 add rbenv and new ruby to the build 2013-04-11 13:54:07 +04:00