diff --git a/.sync.yml b/.sync.yml index 240fb8d..2c9f265 100644 --- a/.sync.yml +++ b/.sync.yml @@ -1,16 +1,13 @@ --- .travis.yml: beaker_sets: - centos6-64 - debian9-64 - debian10-64 - ubuntu1804-64 env: global: - PARALLEL_TEST_PROCESSORS=8 beaker_puppet_collections: - puppet5 - puppet6 -Rakefile: - param_docs_pattern: - - manifests/init.pp diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md index 9773cf4..64a434a 100644 --- a/CONTRIBUTING.md +++ b/CONTRIBUTING.md @@ -1,248 +1,268 @@ Checklist (and a short version for the impatient) ================================================= * Commits: - Make commits of logical units. - Check for unnecessary whitespace with "git diff --check" before committing. - Commit using Unix line endings (check the settings around "crlf" in git-config(1)). - Do not check in commented out code or unneeded files. - The first line of the commit message should be a short description (50 characters is the soft limit, excluding ticket number(s)), and should skip the full stop. - If you have a [https://projects.theforeman.org/projects/puppet-foreman/issues](Redmine issue) number, associate the issue in the message. The first line should start with the issue number in the form "fixes #XXXX - rest of message". [More information on the Redmine style](https://projects.theforeman.org/projects/foreman/wiki/Reviewing_patches-commit_message_format). Tickets are not required for our installer Puppet modules. - If you have a GitHub issue number, associate the issue in the message. End the commit message with "Fixes GH-1234" on a new line. - The body should provide a meaningful commit message, which: - uses the imperative, present tense: "change", not "changed" or "changes". - includes motivation for the change, and contrasts its implementation with the previous behavior. - Make sure that you have tests for the bug you are fixing, or feature you are adding. - Make sure the test suites passes after your commit: `bundle exec rake spec` More information on [testing](#Testing) below - When introducing a large change, make sure it is properly documented in the README.md * Submission: * Pre-requisites: - Make sure you have a [GitHub account](https://github.com/join) * Preferred method: - Fork the repository on GitHub. - Push your changes to a topic branch in your fork of the repository, in a new branch. - Submit a pull request to the repository in the 'theforeman' organization. The long version ================ 1. Make separate commits for logically separate changes. Please break your commits down into logically consistent units which include new or changed tests relevant to the rest of the change. The goal of doing this is to make the diff easier to read for whoever is reviewing your code. In general, the easier your diff is to read, the more likely someone will be happy to review it and get it into the code base. If you are going to refactor a piece of code, please do so as a separate commit from your feature or bug fix changes. If you have many commits to fix one issue, use `git rebase` or `git commit --amend` to combine them into a single commit. We also really appreciate changes that include tests to make sure the bug is not re-introduced, and that the feature is not accidentally broken. Describe the technical detail of the change(s). If your description starts to get too long, that is a good sign that you probably need to split up your commit into more finely grained pieces. Commits which plainly describe the things which help reviewers check the patch and future developers understand the code are much more likely to be merged in with a minimum of bike-shedding or requested changes. Ideally, the commit message would include information, and be in a form suitable for inclusion in the release notes for the version of Puppet that includes them. Please also check that you are not introducing any trailing whitespace or other "whitespace errors". You can do this by running "git diff --check" on your changes before you commit. 2. Sending your patches To submit your changes via a GitHub pull request, we _highly_ recommend that you have them on a topic branch, instead of directly on "master". It makes things much easier to keep track of, especially if you decide to work on another thing before your first change is merged in. GitHub has some pretty good [general documentation](https://help.github.com/) on using their site. They also have documentation on [creating pull requests](https://help.github.com/send-pull-requests/). In general, after pushing your topic branch up to your repository on GitHub, you can switch to the branch in the GitHub UI and click "Pull Request" towards the top of the page in order to open a pull request. 3. Update the related GitHub issue. If there is a GitHub issue associated with the change you submitted, then you should update the ticket to include the location of your branch, along with any other commentary you may wish to make. Testing ======= Getting Started --------------- Our puppet modules provide [`Gemfile`](./Gemfile)s which can tell a ruby package manager such as [bundler](https://bundler.io/) what Ruby packages, or Gems, are required to build, develop, and test this software. -Please make sure you have [bundler installed](https://bundler.io/#getting-started) -on your system, then use it to install all dependencies needed for this project, -by running - -```shell -% bundle install +**Prerequisites** +1. Make sure you have [bundler installed](https://bundler.io/#getting-started) +on your system. If you are using Fedora, you can get `bundler` using + ```shell + sudo dnf install rubygem-bundler + ``` +2. If you are using Fedora, you may need these additional packages + ```shell + sudo dnf install -y ruby-devel redhat-rpm-config + ``` + +Now, go to the root directory of this project and use `bundler` to install all +dependencies needed for this project by running + +```console +$ bundle install Fetching gem metadata from https://rubygems.org/........ Fetching gem metadata from https://rubygems.org/.. Using rake (10.1.0) Using builder (3.2.2) -- 8><-- many more --><8 -- Using rspec-system-puppet (2.2.0) Using serverspec (0.6.3) Using rspec-system-serverspec (1.0.0) Using bundler (1.3.5) Your bundle is complete! Use `bundle show [gemname]` to see where a bundled gem is installed. ``` NOTE some systems may require you to run this command with sudo. If you already have those gems installed, make sure they are up-to-date: ```shell -% bundle update +bundle update ``` With all dependencies in place and up-to-date we can now run the tests: ```shell -% rake spec +rake spec ``` This will execute all the [rspec tests](http://rspec-puppet.com/) tests under [spec/defines](./spec/defines), [spec/classes](./spec/classes), and so on. rspec tests may have the same kind of dependencies as the module they are testing. While the module defines in its [Modulefile](./Modulefile), rspec tests define them in [.fixtures.yml](./fixtures.yml). Writing Tests ------------- Our tests use [rspec-puppet](http://rspec-puppet.com/) to check that classes and defined types work when compiled with Puppet itself. Ideally, we want to test the smallest logical units possible (i.e. a single class, not the whole module), which helps with speed and reduces work when changing other parts of the module. By writing tests we ensure that future versions of the module don't introduce regressions, and that we find issues sooner (in this project) rather than later (when used in a Foreman installation). Each class has its own file within spec/classes/, ending with "_spec.rb" and inside each test file is a section for each test scenario ("describe"). A typical rspec-puppet test for a new class parameter would perhaps start with defining a set of parameters to pass into the class: describe 'with colour parameter' do let :params do {:colour => 'red'} end end The test then has to check for the presence or absence of certain Puppet resources with or without certain properties and relationships. e.g. a test for a service class would ensure the service resource is present, with the right name and the right ensure/enable properties. describe 'with colour parameter' do let :params do {:colour => 'red'} end it 'should configure colour' do should contain_file('/etc/service.conf').with_content('colour: red') end end More advanced topics: * Use rspec-puppet-facts loops: some tests use a loop with "on_supported_os" to test the class under every OS supported in metadata.json. * Test presence of inter-resource require/notify relationships. If you have commit access to the repository =========================================== Even if you have commit access to the repository, you will still need to go through the process above, and have someone else review and merge in your changes. The rule is that all changes must be reviewed by a developer on the project (that did not write the code) to ensure that all changes go through a code review process. Having someone other than the author of the topic branch recorded as performing the merge is the record that they performed the code review. Additional Resources ==================== * [Support and contact details](https://theforeman.org/support.html) * [General Foreman contribution details](https://theforeman.org/contribute.html) * [General GitHub documentation](https://help.github.com/) * [GitHub pull request documentation](https://help.github.com/send-pull-requests/) + +Modulesync +========== + +Various files, including this one, are +[modulesynced](https://github.com/voxpupuli/modulesync) using +[foreman-installer-modulesync](https://github.com/theforeman/foreman-installer-modulesync) +configuration. Changes should be made over there and then synced to +all [managed +modules](https://github.com/theforeman/foreman-installer-modulesync/blob/master/managed_modules.yml). diff --git a/Gemfile b/Gemfile index e471b9e..229015b 100644 --- a/Gemfile +++ b/Gemfile @@ -1,40 +1,20 @@ # This file is managed centrally by modulesync # https://github.com/theforeman/foreman-installer-modulesync source 'https://rubygems.org' gem 'puppet', ENV.key?('PUPPET_VERSION') ? "~> #{ENV['PUPPET_VERSION']}" : '>= 5.5' -gem 'rake' -gem 'rspec', '~> 3.0' -gem 'rspec-puppet', '~> 2.3' -gem 'rspec-puppet-facts', '>= 1.7' -gem 'puppetlabs_spec_helper', '>= 2.1.1' -gem 'puppet-lint', '>= 2' -gem 'puppet-lint-classes_and_types_beginning_with_digits-check' +gem 'kafo_module_lint' gem 'puppet-lint-empty_string-check' gem 'puppet-lint-file_ensure-check' -gem 'puppet-lint-leading_zero-check' gem 'puppet-lint-param-docs', '>= 1.3.0' gem 'puppet-lint-spaceship_operator_without_tag-check' gem 'puppet-lint-strict_indent-check' -gem 'puppet-lint-trailing_comma-check' gem 'puppet-lint-undef_in_function-check' -gem 'puppet-lint-unquoted_string-check' -gem 'puppet-lint-variable_contains_upcase' -gem 'puppet-lint-version_comparison-check' -gem 'simplecov' -gem 'github_changelog_generator', '>= 1.15.0' +gem 'voxpupuli-test', '~> 1.0' +gem 'github_changelog_generator', '>= 1.15.0', {"groups"=>["development"]} gem 'puppet-blacksmith', '>= 4.1.0', {"groups"=>["development"]} -gem 'beaker', '>= 4.2.0', {"groups"=>["system_tests"]} -gem 'beaker-docker', {"groups"=>["system_tests"]} -gem 'beaker-hostgenerator', '>= 1.1.10', {"groups"=>["system_tests"]} -gem 'beaker-puppet', {"groups"=>["system_tests"]} -gem 'beaker-rspec', {"groups"=>["system_tests"]} -gem 'beaker-module_install_helper', {"groups"=>["system_tests"]} -gem 'beaker-puppet_install_helper', {"groups"=>["system_tests"]} -gem 'metadata-json-lint' -gem 'kafo_module_lint' -gem 'parallel_tests' +gem 'voxpupuli-acceptance', '~> 0.1', {"groups"=>["system_tests"]} # vim:ft=ruby diff --git a/Rakefile b/Rakefile index f078f1d..402cbce 100644 --- a/Rakefile +++ b/Rakefile @@ -1,56 +1,40 @@ # This file is managed centrally by modulesync # https://github.com/theforeman/foreman-installer-modulesync -require 'puppetlabs_spec_helper/rake_tasks' -require 'puppet-lint/tasks/puppet-lint' +require 'voxpupuli/test/rake' # blacksmith isn't always present, e.g. on Travis with --without development begin require 'puppet_blacksmith/rake_tasks' Blacksmith::RakeTask.new do |t| t.tag_pattern = "%s" t.tag_message_pattern = "Version %s" t.tag_sign = true end rescue LoadError end begin require 'github_changelog_generator/task' # https://github.com/github-changelog-generator/github-changelog-generator/issues/313 module GitHubChangelogGeneratorExtensions def compound_changelog super.gsub(/(fixes|fixing|refs) \\#(\d+)/i, '\1 [\\#\2](https://projects.theforeman.org/issues/\2)') end end class GitHubChangelogGenerator::Generator prepend GitHubChangelogGeneratorExtensions end GitHubChangelogGenerator::RakeTask.new :changelog do |config| raise "Set CHANGELOG_GITHUB_TOKEN environment variable eg 'export CHANGELOG_GITHUB_TOKEN=valid_token_here'" if Rake.application.top_level_tasks.include? "changelog" and ENV['CHANGELOG_GITHUB_TOKEN'].nil? metadata = JSON.load(File.read('metadata.json')) config.user = 'theforeman' config.project = "puppet-#{metadata['name'].split('-').last}" config.future_release = metadata['version'] config.exclude_labels = ['duplicate', 'question', 'invalid', 'wontfix', 'Modulesync', 'skip-changelog'] end rescue LoadError end - -PuppetLint.configuration.ignore_paths = ["spec/**/*.pp", "pkg/**/*.pp", "vendor/**/*.pp"] -PuppetLint.configuration.log_format = '%{path}:%{line}:%{KIND}: %{message}' - -require 'puppet-lint-param-docs/tasks' -PuppetLintParamDocs.define_selective do |config| - config.pattern = ["manifests/init.pp"] -end - -require 'kafo_module_lint/tasks' -KafoModuleLint::RakeTask.new do |config| - config.pattern = ["manifests/init.pp"] -end - -task :default => [:release_checks] diff --git a/spec/spec_helper.rb b/spec/spec_helper.rb index b94aad1..0e44be1 100644 --- a/spec/spec_helper.rb +++ b/spec/spec_helper.rb @@ -1,96 +1,55 @@ # This file is managed centrally by modulesync # https://github.com/theforeman/foreman-installer-modulesync -RSpec.configure do |c| - c.mock_with :rspec -end - -require 'puppetlabs_spec_helper/module_spec_helper' +require 'voxpupuli/test/spec_helper' -require 'rspec-puppet-facts' -include RspecPuppetFacts - - # Original fact sources: -add_custom_fact :puppet_environmentpath, '/etc/puppetlabs/code/environments' # puppetlabs-stdlib -add_custom_fact :root_home, '/root' # puppetlabs-stdlib # Rough conversion of grepping in the puppet source: # grep defaultfor lib/puppet/provider/service/*.rb add_custom_fact :service_provider, ->(os, facts) do case facts[:osfamily].downcase when 'archlinux' 'systemd' when 'darwin' 'launchd' when 'debian' 'systemd' when 'freebsd' 'freebsd' when 'gentoo' 'openrc' when 'openbsd' 'openbsd' when 'redhat' facts[:operatingsystemrelease].to_i >= 7 ? 'systemd' : 'redhat' when 'suse' facts[:operatingsystemmajrelease].to_i >= 12 ? 'systemd' : 'redhat' when 'windows' 'windows' else 'init' end end -# Workaround for no method in rspec-puppet to pass undef through :params -class Undef - def inspect; 'undef'; end -end - -# Running tests with the ONLY_OS environment variable set -# limits the tested platforms to the specified values. -# Example: ONLY_OS=centos-7-x86_64,ubuntu-14-x86_64 -def only_test_os - if ENV.key?('ONLY_OS') - ENV['ONLY_OS'].split(',') - end -end - -# Running tests with the EXCLUDE_OS environment variable set -# limits the tested platforms to all but the specified values. -# Example: EXCLUDE_OS=centos-7-x86_64,ubuntu-14-x86_64 -def exclude_test_os - if ENV.key?('EXCLUDE_OS') - ENV['EXCLUDE_OS'].split(',') - end -end - -# Use the above environment variables to limit the platforms under test -def on_os_under_test - on_supported_os.reject do |os, facts| - (only_test_os() && !only_test_os.include?(os)) || - (exclude_test_os() && exclude_test_os.include?(os)) - end -end - def get_content(subject, title) is_expected.to contain_file(title) content = subject.resource('file', title).send(:parameters)[:content] content.split(/\n/).reject { |line| line =~ /(^#|^$|^\s+#)/ } end def verify_exact_contents(subject, title, expected_lines) expect(get_content(subject, title)).to match_array(expected_lines) end def verify_concat_fragment_contents(subject, title, expected_lines) is_expected.to contain_concat__fragment(title) content = subject.resource('concat::fragment', title).send(:parameters)[:content] expect(content.split("\n") & expected_lines).to match_array(expected_lines) end def verify_concat_fragment_exact_contents(subject, title, expected_lines) is_expected.to contain_concat__fragment(title) content = subject.resource('concat::fragment', title).send(:parameters)[:content] expect(content.split(/\n/).reject { |line| line =~ /(^#|^$|^\s+#)/ }).to match_array(expected_lines) end Dir["./spec/support/**/*.rb"].sort.each { |f| require f } diff --git a/spec/spec_helper_acceptance.rb b/spec/spec_helper_acceptance.rb index 5bbda1c..55e27b8 100644 --- a/spec/spec_helper_acceptance.rb +++ b/spec/spec_helper_acceptance.rb @@ -1,58 +1,43 @@ -ENV['PUPPET_INSTALL_TYPE'] ||= 'agent' -ENV['BEAKER_IS_PE'] ||= 'no' -ENV['BEAKER_PUPPET_COLLECTION'] ||= 'puppet6' -ENV['BEAKER_debug'] ||= 'true' +require 'voxpupuli/acceptance/spec_helper_acceptance' + ENV['BEAKER_setfile'] ||= 'centos7-64{hostname=centos7-64.example.com}' -ENV['BEAKER_HYPERVISOR'] ||= 'docker' - -require 'beaker-puppet' -require 'beaker-rspec' -require 'beaker/puppet_install_helper' -require 'beaker/module_install_helper' - -run_puppet_install_helper unless ENV['BEAKER_provision'] == 'no' -install_module_on(hosts) -install_module_dependencies_on(hosts) - -RSpec.configure do |c| - # Readable test descriptions - c.formatter = :documentation - - # Configure all nodes in nodeset - c.before :suite do - # Install module and dependencies - hosts.each do |host| - if fact_on(host, 'osfamily') == 'RedHat' - # don't delete downloaded rpm for use with BEAKER_provision=no + - # BEAKER_destroy=no - on host, 'sed -i "s/keepcache=.*/keepcache=1/" /etc/yum.conf' - # refresh check if cache needs refresh on next yum command - on host, 'yum clean expire-cache' - end - if fact_on(host, 'operatingsystem') == 'Ubuntu' - on host, 'apt-get -qq -y install cron' - end + +configure_beaker do |host| + if fact_on(host, 'os.family') == 'RedHat' + unless fact_on(host, 'os.name') == 'Fedora' + # don't delete downloaded rpm for use with BEAKER_provision=no + + # BEAKER_destroy=no + on host, 'sed -i "s/keepcache=.*/keepcache=1/" /etc/yum.conf' + end + # refresh check if cache needs refresh on next yum command + on host, 'yum clean expire-cache' + + # this is absent in the el8 container images used for testing + if fact_on(host, 'os.release.major') == '8' + on host, puppet('resource', 'package', 'glibc-langpack-en', 'ensure=installed') end + elsif fact_on(host, 'os.name') == 'Ubuntu' + on host, 'apt-get -qq -y install cron' end end shared_examples 'a idempotent resource' do it 'applies with no errors' do apply_manifest(pp, catch_failures: true) end it 'applies a second time without changes' do apply_manifest(pp, catch_changes: true) end end shared_examples 'the example' do |name| let(:pp) do - path = File.join(File.dirname(File.dirname(__FILE__)), 'examples', name) + path = File.join(File.dirname(__dir__), 'examples', name) File.read(path) end include_examples 'a idempotent resource' end Dir["./spec/support/acceptance/**/*.rb"].sort.each { |f| require f }