2015-04-27 15:34:16 +00:00
|
|
|
# (c) 2012, Michael DeHaan <michael.dehaan@gmail.com>
|
2018-12-19 08:28:33 +00:00
|
|
|
# Copyright: (c) 2018, Ansible Project
|
|
|
|
# GNU General Public License v3.0+ (see COPYING or https://www.gnu.org/licenses/gpl-3.0.txt)
|
2015-04-27 15:34:16 +00:00
|
|
|
|
2015-10-20 01:36:19 +00:00
|
|
|
from __future__ import (absolute_import, division, print_function)
|
|
|
|
__metaclass__ = type
|
|
|
|
|
2014-11-14 22:14:08 +00:00
|
|
|
import os
|
|
|
|
import stat
|
|
|
|
|
2018-12-18 02:10:59 +00:00
|
|
|
from ansible import context
|
2015-05-01 01:22:23 +00:00
|
|
|
from ansible.cli import CLI
|
2018-12-20 18:07:49 +00:00
|
|
|
from ansible.cli.arguments import optparse_helpers as opt_help
|
2015-06-02 15:02:40 +00:00
|
|
|
from ansible.errors import AnsibleError, AnsibleOptionsError
|
2014-11-14 22:14:08 +00:00
|
|
|
from ansible.executor.playbook_executor import PlaybookExecutor
|
Become plugins (#50991)
* [WIP] become plugins
Move from hardcoded method to plugins for ease of use, expansion and overrides
- load into connection as it is going to be the main consumer
- play_context will also use to keep backwards compat API
- ensure shell is used to construct commands when needed
- migrate settings remove from base config in favor of plugin specific configs
- cleanup ansible-doc
- add become plugin docs
- remove deprecated sudo/su code and keywords
- adjust become options for cli
- set plugin options from context
- ensure config defs are avaialbe before instance
- refactored getting the shell plugin, fixed tests
- changed into regex as they were string matching, which does not work with random string generation
- explicitly set flags for play context tests
- moved plugin loading up front
- now loads for basedir also
- allow pyc/o for non m modules
- fixes to tests and some plugins
- migrate to play objects fro play_context
- simiplify gathering
- added utf8 headers
- moved option setting
- add fail msg to dzdo
- use tuple for multiple options on fail/missing
- fix relative plugin paths
- shift from play context to play
- all tasks already inherit this from play directly
- remove obsolete 'set play'
- correct environment handling
- add wrap_exe option to pfexec
- fix runas to noop
- fixed setting play context
- added password configs
- removed required false
- remove from doc building till they are ready
future development:
- deal with 'enable' and 'runas' which are not 'command wrappers' but 'state flags' and currently hardcoded in diff subsystems
* cleanup
remove callers to removed func
removed --sudo cli doc refs
remove runas become_exe
ensure keyerorr on plugin
also fix backwards compat, missing method is attributeerror, not ansible error
get remote_user consistently
ignore missing system_tmpdirs on plugin load
correct config precedence
add deprecation
fix networking imports
backwards compat for plugins using BECOME_METHODS
* Port become_plugins to context.CLIARGS
This is a work in progress:
* Stop passing options around everywhere as we can use context.CLIARGS
instead
* Refactor make_become_commands as asked for by alikins
* Typo in comment fix
* Stop loading values from the cli in more than one place
Both play and play_context were saving default values from the cli
arguments directly. This changes things so that the default values are
loaded into the play and then play_context takes them from there.
* Rename BECOME_PLUGIN_PATH to DEFAULT_BECOME_PLUGIN_PATH
As alikins said, all other plugin paths are named
DEFAULT_plugintype_PLUGIN_PATH. If we're going to rename these, that
should be done all at one time rather than piecemeal.
* One to throw away
This is a set of hacks to get setting FieldAttribute defaults to command
line args to work. It's not fully done yet.
After talking it over with sivel and jimi-c this should be done by
fixing FieldAttributeBase and _get_parent_attribute() calls to do the
right thing when there is a non-None default.
What we want to be able to do ideally is something like this:
class Base(FieldAttributeBase):
_check_mode = FieldAttribute([..] default=lambda: context.CLIARGS['check'])
class Play(Base):
# lambda so that we have a chance to parse the command line args
# before we get here. In the future we might be able to restructure
# this so that the cli parsing code runs before these classes are
# defined.
class Task(Base):
pass
And still have a playbook like this function:
---
- hosts:
tasks:
- command: whoami
check_mode: True
(The check_mode test that is added as a separate commit in this PR will
let you test variations on this case).
There's a few separate reasons that the code doesn't let us do this or
a non-ugly workaround for this as written right now. The fix that
jimi-c, sivel, and I talked about may let us do this or it may still
require a workaround (but less ugly) (having one class that has the
FieldAttributes with default values and one class that inherits from
that but just overrides the FieldAttributes which now have defaults)
* Revert "One to throw away"
This reverts commit 23aa883cbed11429ef1be2a2d0ed18f83a3b8064.
* Set FieldAttr defaults directly from CLIARGS
* Remove dead code
* Move timeout directly to PlayContext, it's never needed on Play
* just for backwards compat, add a static version of BECOME_METHODS to constants
* Make the become attr on the connection public, since it's used outside of the connection
* Logic fix
* Nuke connection testing if it supports specific become methods
* Remove unused vars
* Address rebase issues
* Fix path encoding issue
* Remove unused import
* Various cleanups
* Restore network_cli check in _low_level_execute_command
* type improvements for cliargs_deferred_get and swap shallowcopy to default to False
* minor cleanups
* Allow the su plugin to work, since it doesn't define a prompt the same way
* Fix up ksu become plugin
* Only set prompt if build_become_command was called
* Add helper to assist connection plugins in knowing they need to wait for a prompt
* Fix tests and code expectations
* Doc updates
* Various additional minor cleanups
* Make doas functional
* Don't change connection signature, load become plugin from TaskExecutor
* Remove unused imports
* Add comment about setting the become plugin on the playcontext
* Fix up tests for recent changes
* Support 'Password:' natively for the doas plugin
* Make default prompts raw
* wording cleanups. ci_complete
* Remove unrelated changes
* Address spelling mistake
* Restore removed test, and udpate to use new functionality
* Add changelog fragment
* Don't hard fail in set_attributes_from_cli on missing CLI keys
* Remove unrelated change to loader
* Remove internal deprecated FieldAttributes now
* Emit deprecation warnings now
2019-02-11 17:27:44 +00:00
|
|
|
from ansible.module_utils._text import to_bytes
|
2016-01-25 18:04:52 +00:00
|
|
|
from ansible.playbook.block import Block
|
2018-11-20 23:06:51 +00:00
|
|
|
from ansible.utils.display import Display
|
2019-03-28 17:41:39 +00:00
|
|
|
from ansible.utils.collection_loader import set_collection_playbook_paths
|
Become plugins (#50991)
* [WIP] become plugins
Move from hardcoded method to plugins for ease of use, expansion and overrides
- load into connection as it is going to be the main consumer
- play_context will also use to keep backwards compat API
- ensure shell is used to construct commands when needed
- migrate settings remove from base config in favor of plugin specific configs
- cleanup ansible-doc
- add become plugin docs
- remove deprecated sudo/su code and keywords
- adjust become options for cli
- set plugin options from context
- ensure config defs are avaialbe before instance
- refactored getting the shell plugin, fixed tests
- changed into regex as they were string matching, which does not work with random string generation
- explicitly set flags for play context tests
- moved plugin loading up front
- now loads for basedir also
- allow pyc/o for non m modules
- fixes to tests and some plugins
- migrate to play objects fro play_context
- simiplify gathering
- added utf8 headers
- moved option setting
- add fail msg to dzdo
- use tuple for multiple options on fail/missing
- fix relative plugin paths
- shift from play context to play
- all tasks already inherit this from play directly
- remove obsolete 'set play'
- correct environment handling
- add wrap_exe option to pfexec
- fix runas to noop
- fixed setting play context
- added password configs
- removed required false
- remove from doc building till they are ready
future development:
- deal with 'enable' and 'runas' which are not 'command wrappers' but 'state flags' and currently hardcoded in diff subsystems
* cleanup
remove callers to removed func
removed --sudo cli doc refs
remove runas become_exe
ensure keyerorr on plugin
also fix backwards compat, missing method is attributeerror, not ansible error
get remote_user consistently
ignore missing system_tmpdirs on plugin load
correct config precedence
add deprecation
fix networking imports
backwards compat for plugins using BECOME_METHODS
* Port become_plugins to context.CLIARGS
This is a work in progress:
* Stop passing options around everywhere as we can use context.CLIARGS
instead
* Refactor make_become_commands as asked for by alikins
* Typo in comment fix
* Stop loading values from the cli in more than one place
Both play and play_context were saving default values from the cli
arguments directly. This changes things so that the default values are
loaded into the play and then play_context takes them from there.
* Rename BECOME_PLUGIN_PATH to DEFAULT_BECOME_PLUGIN_PATH
As alikins said, all other plugin paths are named
DEFAULT_plugintype_PLUGIN_PATH. If we're going to rename these, that
should be done all at one time rather than piecemeal.
* One to throw away
This is a set of hacks to get setting FieldAttribute defaults to command
line args to work. It's not fully done yet.
After talking it over with sivel and jimi-c this should be done by
fixing FieldAttributeBase and _get_parent_attribute() calls to do the
right thing when there is a non-None default.
What we want to be able to do ideally is something like this:
class Base(FieldAttributeBase):
_check_mode = FieldAttribute([..] default=lambda: context.CLIARGS['check'])
class Play(Base):
# lambda so that we have a chance to parse the command line args
# before we get here. In the future we might be able to restructure
# this so that the cli parsing code runs before these classes are
# defined.
class Task(Base):
pass
And still have a playbook like this function:
---
- hosts:
tasks:
- command: whoami
check_mode: True
(The check_mode test that is added as a separate commit in this PR will
let you test variations on this case).
There's a few separate reasons that the code doesn't let us do this or
a non-ugly workaround for this as written right now. The fix that
jimi-c, sivel, and I talked about may let us do this or it may still
require a workaround (but less ugly) (having one class that has the
FieldAttributes with default values and one class that inherits from
that but just overrides the FieldAttributes which now have defaults)
* Revert "One to throw away"
This reverts commit 23aa883cbed11429ef1be2a2d0ed18f83a3b8064.
* Set FieldAttr defaults directly from CLIARGS
* Remove dead code
* Move timeout directly to PlayContext, it's never needed on Play
* just for backwards compat, add a static version of BECOME_METHODS to constants
* Make the become attr on the connection public, since it's used outside of the connection
* Logic fix
* Nuke connection testing if it supports specific become methods
* Remove unused vars
* Address rebase issues
* Fix path encoding issue
* Remove unused import
* Various cleanups
* Restore network_cli check in _low_level_execute_command
* type improvements for cliargs_deferred_get and swap shallowcopy to default to False
* minor cleanups
* Allow the su plugin to work, since it doesn't define a prompt the same way
* Fix up ksu become plugin
* Only set prompt if build_become_command was called
* Add helper to assist connection plugins in knowing they need to wait for a prompt
* Fix tests and code expectations
* Doc updates
* Various additional minor cleanups
* Make doas functional
* Don't change connection signature, load become plugin from TaskExecutor
* Remove unused imports
* Add comment about setting the become plugin on the playcontext
* Fix up tests for recent changes
* Support 'Password:' natively for the doas plugin
* Make default prompts raw
* wording cleanups. ci_complete
* Remove unrelated changes
* Address spelling mistake
* Restore removed test, and udpate to use new functionality
* Add changelog fragment
* Don't hard fail in set_attributes_from_cli on missing CLI keys
* Remove unrelated change to loader
* Remove internal deprecated FieldAttributes now
* Emit deprecation warnings now
2019-02-11 17:27:44 +00:00
|
|
|
from ansible.plugins.loader import add_all_plugin_dirs
|
2015-01-19 21:39:45 +00:00
|
|
|
|
2019-03-28 17:41:39 +00:00
|
|
|
|
2018-11-20 23:06:51 +00:00
|
|
|
display = Display()
|
2015-11-10 19:40:55 +00:00
|
|
|
|
|
|
|
|
2015-04-27 11:31:41 +00:00
|
|
|
class PlaybookCLI(CLI):
|
2017-03-23 05:11:40 +00:00
|
|
|
''' the tool to run *Ansible playbooks*, which are a configuration and multinode deployment system.
|
|
|
|
See the project home page (https://docs.ansible.com) for more information. '''
|
|
|
|
|
2018-12-18 02:10:59 +00:00
|
|
|
def init_parser(self):
|
2015-04-27 11:31:41 +00:00
|
|
|
|
|
|
|
# create parser for CLI options
|
2018-12-18 02:10:59 +00:00
|
|
|
super(PlaybookCLI, self).init_parser(
|
2017-06-02 11:14:11 +00:00
|
|
|
usage="%prog [options] playbook.yml [playbook2 ...]",
|
2018-12-19 08:28:33 +00:00
|
|
|
desc="Runs Ansible playbooks, executing the defined tasks on the targeted hosts.")
|
|
|
|
|
|
|
|
opt_help.add_connect_options(self.parser)
|
|
|
|
opt_help.add_meta_options(self.parser)
|
|
|
|
opt_help.add_runas_options(self.parser)
|
|
|
|
opt_help.add_subset_options(self.parser)
|
|
|
|
opt_help.add_check_options(self.parser)
|
|
|
|
opt_help.add_inventory_options(self.parser)
|
|
|
|
opt_help.add_runtask_options(self.parser)
|
|
|
|
opt_help.add_vault_options(self.parser)
|
|
|
|
opt_help.add_fork_options(self.parser)
|
|
|
|
opt_help.add_module_options(self.parser)
|
2015-04-27 11:31:41 +00:00
|
|
|
|
|
|
|
# ansible playbook specific opts
|
2018-12-18 02:10:59 +00:00
|
|
|
self.parser.add_option('--list-tasks', dest='listtasks', action='store_true',
|
|
|
|
help="list all tasks that would be executed")
|
|
|
|
self.parser.add_option('--list-tags', dest='listtags', action='store_true',
|
|
|
|
help="list all available tags")
|
|
|
|
self.parser.add_option('--step', dest='step', action='store_true',
|
|
|
|
help="one-step-at-a-time: confirm each task before running")
|
|
|
|
self.parser.add_option('--start-at-task', dest='start_at_task',
|
|
|
|
help="start the playbook at the task matching this name")
|
|
|
|
|
|
|
|
def post_process_args(self, options, args):
|
|
|
|
options, args = super(PlaybookCLI, self).post_process_args(options, args)
|
|
|
|
|
|
|
|
if len(args) == 0:
|
2015-06-02 15:02:40 +00:00
|
|
|
raise AnsibleOptionsError("You must specify a playbook file to run")
|
|
|
|
|
2018-12-18 02:10:59 +00:00
|
|
|
display.verbosity = options.verbosity
|
|
|
|
self.validate_conflicts(options, runas_opts=True, vault_opts=True, fork_opts=True)
|
|
|
|
|
|
|
|
return options, args
|
2015-04-27 11:31:41 +00:00
|
|
|
|
|
|
|
def run(self):
|
|
|
|
|
2015-07-04 14:23:30 +00:00
|
|
|
super(PlaybookCLI, self).run()
|
|
|
|
|
2015-04-27 11:31:41 +00:00
|
|
|
# Note: slightly wrong, this is written so that implicit localhost
|
2018-12-18 02:10:59 +00:00
|
|
|
# manages passwords
|
2017-06-02 11:14:11 +00:00
|
|
|
sshpass = None
|
|
|
|
becomepass = None
|
2015-04-27 11:31:41 +00:00
|
|
|
passwords = {}
|
|
|
|
|
2016-10-31 15:54:33 +00:00
|
|
|
# initial error check, to make sure all specified playbooks are accessible
|
|
|
|
# before we start running anything through the playbook executor
|
2019-03-28 17:41:39 +00:00
|
|
|
|
|
|
|
b_playbook_dirs = []
|
2018-12-18 02:10:59 +00:00
|
|
|
for playbook in context.CLIARGS['args']:
|
2016-10-31 15:54:33 +00:00
|
|
|
if not os.path.exists(playbook):
|
|
|
|
raise AnsibleError("the playbook: %s could not be found" % playbook)
|
|
|
|
if not (os.path.isfile(playbook) or stat.S_ISFIFO(os.stat(playbook).st_mode)):
|
|
|
|
raise AnsibleError("the playbook: %s does not appear to be a file" % playbook)
|
2019-03-28 17:41:39 +00:00
|
|
|
|
|
|
|
b_playbook_dir = os.path.dirname(os.path.abspath(to_bytes(playbook, errors='surrogate_or_strict')))
|
Become plugins (#50991)
* [WIP] become plugins
Move from hardcoded method to plugins for ease of use, expansion and overrides
- load into connection as it is going to be the main consumer
- play_context will also use to keep backwards compat API
- ensure shell is used to construct commands when needed
- migrate settings remove from base config in favor of plugin specific configs
- cleanup ansible-doc
- add become plugin docs
- remove deprecated sudo/su code and keywords
- adjust become options for cli
- set plugin options from context
- ensure config defs are avaialbe before instance
- refactored getting the shell plugin, fixed tests
- changed into regex as they were string matching, which does not work with random string generation
- explicitly set flags for play context tests
- moved plugin loading up front
- now loads for basedir also
- allow pyc/o for non m modules
- fixes to tests and some plugins
- migrate to play objects fro play_context
- simiplify gathering
- added utf8 headers
- moved option setting
- add fail msg to dzdo
- use tuple for multiple options on fail/missing
- fix relative plugin paths
- shift from play context to play
- all tasks already inherit this from play directly
- remove obsolete 'set play'
- correct environment handling
- add wrap_exe option to pfexec
- fix runas to noop
- fixed setting play context
- added password configs
- removed required false
- remove from doc building till they are ready
future development:
- deal with 'enable' and 'runas' which are not 'command wrappers' but 'state flags' and currently hardcoded in diff subsystems
* cleanup
remove callers to removed func
removed --sudo cli doc refs
remove runas become_exe
ensure keyerorr on plugin
also fix backwards compat, missing method is attributeerror, not ansible error
get remote_user consistently
ignore missing system_tmpdirs on plugin load
correct config precedence
add deprecation
fix networking imports
backwards compat for plugins using BECOME_METHODS
* Port become_plugins to context.CLIARGS
This is a work in progress:
* Stop passing options around everywhere as we can use context.CLIARGS
instead
* Refactor make_become_commands as asked for by alikins
* Typo in comment fix
* Stop loading values from the cli in more than one place
Both play and play_context were saving default values from the cli
arguments directly. This changes things so that the default values are
loaded into the play and then play_context takes them from there.
* Rename BECOME_PLUGIN_PATH to DEFAULT_BECOME_PLUGIN_PATH
As alikins said, all other plugin paths are named
DEFAULT_plugintype_PLUGIN_PATH. If we're going to rename these, that
should be done all at one time rather than piecemeal.
* One to throw away
This is a set of hacks to get setting FieldAttribute defaults to command
line args to work. It's not fully done yet.
After talking it over with sivel and jimi-c this should be done by
fixing FieldAttributeBase and _get_parent_attribute() calls to do the
right thing when there is a non-None default.
What we want to be able to do ideally is something like this:
class Base(FieldAttributeBase):
_check_mode = FieldAttribute([..] default=lambda: context.CLIARGS['check'])
class Play(Base):
# lambda so that we have a chance to parse the command line args
# before we get here. In the future we might be able to restructure
# this so that the cli parsing code runs before these classes are
# defined.
class Task(Base):
pass
And still have a playbook like this function:
---
- hosts:
tasks:
- command: whoami
check_mode: True
(The check_mode test that is added as a separate commit in this PR will
let you test variations on this case).
There's a few separate reasons that the code doesn't let us do this or
a non-ugly workaround for this as written right now. The fix that
jimi-c, sivel, and I talked about may let us do this or it may still
require a workaround (but less ugly) (having one class that has the
FieldAttributes with default values and one class that inherits from
that but just overrides the FieldAttributes which now have defaults)
* Revert "One to throw away"
This reverts commit 23aa883cbed11429ef1be2a2d0ed18f83a3b8064.
* Set FieldAttr defaults directly from CLIARGS
* Remove dead code
* Move timeout directly to PlayContext, it's never needed on Play
* just for backwards compat, add a static version of BECOME_METHODS to constants
* Make the become attr on the connection public, since it's used outside of the connection
* Logic fix
* Nuke connection testing if it supports specific become methods
* Remove unused vars
* Address rebase issues
* Fix path encoding issue
* Remove unused import
* Various cleanups
* Restore network_cli check in _low_level_execute_command
* type improvements for cliargs_deferred_get and swap shallowcopy to default to False
* minor cleanups
* Allow the su plugin to work, since it doesn't define a prompt the same way
* Fix up ksu become plugin
* Only set prompt if build_become_command was called
* Add helper to assist connection plugins in knowing they need to wait for a prompt
* Fix tests and code expectations
* Doc updates
* Various additional minor cleanups
* Make doas functional
* Don't change connection signature, load become plugin from TaskExecutor
* Remove unused imports
* Add comment about setting the become plugin on the playcontext
* Fix up tests for recent changes
* Support 'Password:' natively for the doas plugin
* Make default prompts raw
* wording cleanups. ci_complete
* Remove unrelated changes
* Address spelling mistake
* Restore removed test, and udpate to use new functionality
* Add changelog fragment
* Don't hard fail in set_attributes_from_cli on missing CLI keys
* Remove unrelated change to loader
* Remove internal deprecated FieldAttributes now
* Emit deprecation warnings now
2019-02-11 17:27:44 +00:00
|
|
|
# load plugins from all playbooks in case they add callbacks/inventory/etc
|
2019-03-28 17:41:39 +00:00
|
|
|
add_all_plugin_dirs(b_playbook_dir)
|
|
|
|
|
|
|
|
b_playbook_dirs.append(b_playbook_dir)
|
|
|
|
|
|
|
|
set_collection_playbook_paths(b_playbook_dirs)
|
2016-10-31 15:54:33 +00:00
|
|
|
|
2015-04-27 11:31:41 +00:00
|
|
|
# don't deal with privilege escalation or passwords when we don't need to
|
2018-12-18 02:10:59 +00:00
|
|
|
if not (context.CLIARGS['listhosts'] or context.CLIARGS['listtasks'] or
|
|
|
|
context.CLIARGS['listtags'] or context.CLIARGS['syntax']):
|
2015-04-27 11:31:41 +00:00
|
|
|
(sshpass, becomepass) = self.ask_passwords()
|
2017-06-02 11:14:11 +00:00
|
|
|
passwords = {'conn_pass': sshpass, 'become_pass': becomepass}
|
2015-04-27 11:31:41 +00:00
|
|
|
|
Become plugins (#50991)
* [WIP] become plugins
Move from hardcoded method to plugins for ease of use, expansion and overrides
- load into connection as it is going to be the main consumer
- play_context will also use to keep backwards compat API
- ensure shell is used to construct commands when needed
- migrate settings remove from base config in favor of plugin specific configs
- cleanup ansible-doc
- add become plugin docs
- remove deprecated sudo/su code and keywords
- adjust become options for cli
- set plugin options from context
- ensure config defs are avaialbe before instance
- refactored getting the shell plugin, fixed tests
- changed into regex as they were string matching, which does not work with random string generation
- explicitly set flags for play context tests
- moved plugin loading up front
- now loads for basedir also
- allow pyc/o for non m modules
- fixes to tests and some plugins
- migrate to play objects fro play_context
- simiplify gathering
- added utf8 headers
- moved option setting
- add fail msg to dzdo
- use tuple for multiple options on fail/missing
- fix relative plugin paths
- shift from play context to play
- all tasks already inherit this from play directly
- remove obsolete 'set play'
- correct environment handling
- add wrap_exe option to pfexec
- fix runas to noop
- fixed setting play context
- added password configs
- removed required false
- remove from doc building till they are ready
future development:
- deal with 'enable' and 'runas' which are not 'command wrappers' but 'state flags' and currently hardcoded in diff subsystems
* cleanup
remove callers to removed func
removed --sudo cli doc refs
remove runas become_exe
ensure keyerorr on plugin
also fix backwards compat, missing method is attributeerror, not ansible error
get remote_user consistently
ignore missing system_tmpdirs on plugin load
correct config precedence
add deprecation
fix networking imports
backwards compat for plugins using BECOME_METHODS
* Port become_plugins to context.CLIARGS
This is a work in progress:
* Stop passing options around everywhere as we can use context.CLIARGS
instead
* Refactor make_become_commands as asked for by alikins
* Typo in comment fix
* Stop loading values from the cli in more than one place
Both play and play_context were saving default values from the cli
arguments directly. This changes things so that the default values are
loaded into the play and then play_context takes them from there.
* Rename BECOME_PLUGIN_PATH to DEFAULT_BECOME_PLUGIN_PATH
As alikins said, all other plugin paths are named
DEFAULT_plugintype_PLUGIN_PATH. If we're going to rename these, that
should be done all at one time rather than piecemeal.
* One to throw away
This is a set of hacks to get setting FieldAttribute defaults to command
line args to work. It's not fully done yet.
After talking it over with sivel and jimi-c this should be done by
fixing FieldAttributeBase and _get_parent_attribute() calls to do the
right thing when there is a non-None default.
What we want to be able to do ideally is something like this:
class Base(FieldAttributeBase):
_check_mode = FieldAttribute([..] default=lambda: context.CLIARGS['check'])
class Play(Base):
# lambda so that we have a chance to parse the command line args
# before we get here. In the future we might be able to restructure
# this so that the cli parsing code runs before these classes are
# defined.
class Task(Base):
pass
And still have a playbook like this function:
---
- hosts:
tasks:
- command: whoami
check_mode: True
(The check_mode test that is added as a separate commit in this PR will
let you test variations on this case).
There's a few separate reasons that the code doesn't let us do this or
a non-ugly workaround for this as written right now. The fix that
jimi-c, sivel, and I talked about may let us do this or it may still
require a workaround (but less ugly) (having one class that has the
FieldAttributes with default values and one class that inherits from
that but just overrides the FieldAttributes which now have defaults)
* Revert "One to throw away"
This reverts commit 23aa883cbed11429ef1be2a2d0ed18f83a3b8064.
* Set FieldAttr defaults directly from CLIARGS
* Remove dead code
* Move timeout directly to PlayContext, it's never needed on Play
* just for backwards compat, add a static version of BECOME_METHODS to constants
* Make the become attr on the connection public, since it's used outside of the connection
* Logic fix
* Nuke connection testing if it supports specific become methods
* Remove unused vars
* Address rebase issues
* Fix path encoding issue
* Remove unused import
* Various cleanups
* Restore network_cli check in _low_level_execute_command
* type improvements for cliargs_deferred_get and swap shallowcopy to default to False
* minor cleanups
* Allow the su plugin to work, since it doesn't define a prompt the same way
* Fix up ksu become plugin
* Only set prompt if build_become_command was called
* Add helper to assist connection plugins in knowing they need to wait for a prompt
* Fix tests and code expectations
* Doc updates
* Various additional minor cleanups
* Make doas functional
* Don't change connection signature, load become plugin from TaskExecutor
* Remove unused imports
* Add comment about setting the become plugin on the playcontext
* Fix up tests for recent changes
* Support 'Password:' natively for the doas plugin
* Make default prompts raw
* wording cleanups. ci_complete
* Remove unrelated changes
* Address spelling mistake
* Restore removed test, and udpate to use new functionality
* Add changelog fragment
* Don't hard fail in set_attributes_from_cli on missing CLI keys
* Remove unrelated change to loader
* Remove internal deprecated FieldAttributes now
* Emit deprecation warnings now
2019-02-11 17:27:44 +00:00
|
|
|
# create base objects
|
2018-12-18 02:10:59 +00:00
|
|
|
loader, inventory, variable_manager = self._play_prereqs()
|
2015-04-27 11:31:41 +00:00
|
|
|
|
2019-02-13 17:52:30 +00:00
|
|
|
# (which is not returned in list_hosts()) is taken into account for
|
|
|
|
# warning if inventory is empty. But it can't be taken into account for
|
|
|
|
# checking if limit doesn't match any hosts. Instead we don't worry about
|
|
|
|
# limit if only implicit localhost was in inventory to start with.
|
|
|
|
#
|
|
|
|
# Fix this when we rewrite inventory by making localhost a real host (and thus show up in list_hosts())
|
|
|
|
CLI.get_host_list(inventory, context.CLIARGS['subset'])
|
|
|
|
|
2016-09-07 16:12:41 +00:00
|
|
|
# flush fact cache if requested
|
2018-12-18 02:10:59 +00:00
|
|
|
if context.CLIARGS['flush_cache']:
|
2016-12-13 19:35:15 +00:00
|
|
|
self._flush_cache(inventory, variable_manager)
|
2016-09-07 16:12:41 +00:00
|
|
|
|
2015-04-27 11:31:41 +00:00
|
|
|
# create the playbook executor, which manages running the plays via a task queue manager
|
2018-12-18 02:10:59 +00:00
|
|
|
pbex = PlaybookExecutor(playbooks=context.CLIARGS['args'], inventory=inventory,
|
|
|
|
variable_manager=variable_manager, loader=loader,
|
2017-03-23 01:50:28 +00:00
|
|
|
passwords=passwords)
|
2015-04-27 11:31:41 +00:00
|
|
|
|
|
|
|
results = pbex.run()
|
|
|
|
|
|
|
|
if isinstance(results, list):
|
|
|
|
for p in results:
|
|
|
|
|
2015-11-10 19:40:55 +00:00
|
|
|
display.display('\nplaybook: %s' % p['playbook'])
|
2015-12-17 21:01:56 +00:00
|
|
|
for idx, play in enumerate(p['plays']):
|
2016-12-22 03:00:18 +00:00
|
|
|
if play._included_path is not None:
|
|
|
|
loader.set_basedir(play._included_path)
|
|
|
|
else:
|
|
|
|
pb_dir = os.path.realpath(os.path.dirname(p['playbook']))
|
|
|
|
loader.set_basedir(pb_dir)
|
|
|
|
|
2015-12-17 21:01:56 +00:00
|
|
|
msg = "\n play #%d (%s): %s" % (idx + 1, ','.join(play.hosts), play.name)
|
|
|
|
mytags = set(play.tags)
|
2015-12-17 21:30:23 +00:00
|
|
|
msg += '\tTAGS: [%s]' % (','.join(mytags))
|
2015-07-29 02:03:50 +00:00
|
|
|
|
2018-12-18 02:10:59 +00:00
|
|
|
if context.CLIARGS['listhosts']:
|
2015-07-29 02:03:50 +00:00
|
|
|
playhosts = set(inventory.get_hosts(play.hosts))
|
2015-07-29 18:56:22 +00:00
|
|
|
msg += "\n pattern: %s\n hosts (%d):" % (play.hosts, len(playhosts))
|
2015-07-29 02:03:50 +00:00
|
|
|
for host in playhosts:
|
2015-07-29 02:31:40 +00:00
|
|
|
msg += "\n %s" % host
|
2015-07-29 02:03:50 +00:00
|
|
|
|
2015-11-10 19:40:55 +00:00
|
|
|
display.display(msg)
|
2015-07-29 02:03:50 +00:00
|
|
|
|
2015-12-17 21:30:23 +00:00
|
|
|
all_tags = set()
|
2018-12-18 02:10:59 +00:00
|
|
|
if context.CLIARGS['listtags'] or context.CLIARGS['listtasks']:
|
2015-12-17 21:30:23 +00:00
|
|
|
taskmsg = ''
|
2018-12-18 02:10:59 +00:00
|
|
|
if context.CLIARGS['listtasks']:
|
2015-12-17 21:30:23 +00:00
|
|
|
taskmsg = ' tasks:\n'
|
2015-07-29 02:30:59 +00:00
|
|
|
|
2016-01-25 18:04:52 +00:00
|
|
|
def _process_block(b):
|
|
|
|
taskmsg = ''
|
|
|
|
for task in b.block:
|
|
|
|
if isinstance(task, Block):
|
|
|
|
taskmsg += _process_block(task)
|
|
|
|
else:
|
|
|
|
if task.action == 'meta':
|
|
|
|
continue
|
|
|
|
|
|
|
|
all_tags.update(task.tags)
|
2018-12-18 02:10:59 +00:00
|
|
|
if context.CLIARGS['listtasks']:
|
2016-01-25 18:04:52 +00:00
|
|
|
cur_tags = list(mytags.union(set(task.tags)))
|
|
|
|
cur_tags.sort()
|
|
|
|
if task.name:
|
|
|
|
taskmsg += " %s" % task.get_name()
|
|
|
|
else:
|
|
|
|
taskmsg += " %s" % task.action
|
|
|
|
taskmsg += "\tTAGS: [%s]\n" % ', '.join(cur_tags)
|
|
|
|
|
|
|
|
return taskmsg
|
|
|
|
|
2017-05-23 21:16:49 +00:00
|
|
|
all_vars = variable_manager.get_vars(play=play)
|
2015-07-29 02:30:59 +00:00
|
|
|
for block in play.compile():
|
Become plugins (#50991)
* [WIP] become plugins
Move from hardcoded method to plugins for ease of use, expansion and overrides
- load into connection as it is going to be the main consumer
- play_context will also use to keep backwards compat API
- ensure shell is used to construct commands when needed
- migrate settings remove from base config in favor of plugin specific configs
- cleanup ansible-doc
- add become plugin docs
- remove deprecated sudo/su code and keywords
- adjust become options for cli
- set plugin options from context
- ensure config defs are avaialbe before instance
- refactored getting the shell plugin, fixed tests
- changed into regex as they were string matching, which does not work with random string generation
- explicitly set flags for play context tests
- moved plugin loading up front
- now loads for basedir also
- allow pyc/o for non m modules
- fixes to tests and some plugins
- migrate to play objects fro play_context
- simiplify gathering
- added utf8 headers
- moved option setting
- add fail msg to dzdo
- use tuple for multiple options on fail/missing
- fix relative plugin paths
- shift from play context to play
- all tasks already inherit this from play directly
- remove obsolete 'set play'
- correct environment handling
- add wrap_exe option to pfexec
- fix runas to noop
- fixed setting play context
- added password configs
- removed required false
- remove from doc building till they are ready
future development:
- deal with 'enable' and 'runas' which are not 'command wrappers' but 'state flags' and currently hardcoded in diff subsystems
* cleanup
remove callers to removed func
removed --sudo cli doc refs
remove runas become_exe
ensure keyerorr on plugin
also fix backwards compat, missing method is attributeerror, not ansible error
get remote_user consistently
ignore missing system_tmpdirs on plugin load
correct config precedence
add deprecation
fix networking imports
backwards compat for plugins using BECOME_METHODS
* Port become_plugins to context.CLIARGS
This is a work in progress:
* Stop passing options around everywhere as we can use context.CLIARGS
instead
* Refactor make_become_commands as asked for by alikins
* Typo in comment fix
* Stop loading values from the cli in more than one place
Both play and play_context were saving default values from the cli
arguments directly. This changes things so that the default values are
loaded into the play and then play_context takes them from there.
* Rename BECOME_PLUGIN_PATH to DEFAULT_BECOME_PLUGIN_PATH
As alikins said, all other plugin paths are named
DEFAULT_plugintype_PLUGIN_PATH. If we're going to rename these, that
should be done all at one time rather than piecemeal.
* One to throw away
This is a set of hacks to get setting FieldAttribute defaults to command
line args to work. It's not fully done yet.
After talking it over with sivel and jimi-c this should be done by
fixing FieldAttributeBase and _get_parent_attribute() calls to do the
right thing when there is a non-None default.
What we want to be able to do ideally is something like this:
class Base(FieldAttributeBase):
_check_mode = FieldAttribute([..] default=lambda: context.CLIARGS['check'])
class Play(Base):
# lambda so that we have a chance to parse the command line args
# before we get here. In the future we might be able to restructure
# this so that the cli parsing code runs before these classes are
# defined.
class Task(Base):
pass
And still have a playbook like this function:
---
- hosts:
tasks:
- command: whoami
check_mode: True
(The check_mode test that is added as a separate commit in this PR will
let you test variations on this case).
There's a few separate reasons that the code doesn't let us do this or
a non-ugly workaround for this as written right now. The fix that
jimi-c, sivel, and I talked about may let us do this or it may still
require a workaround (but less ugly) (having one class that has the
FieldAttributes with default values and one class that inherits from
that but just overrides the FieldAttributes which now have defaults)
* Revert "One to throw away"
This reverts commit 23aa883cbed11429ef1be2a2d0ed18f83a3b8064.
* Set FieldAttr defaults directly from CLIARGS
* Remove dead code
* Move timeout directly to PlayContext, it's never needed on Play
* just for backwards compat, add a static version of BECOME_METHODS to constants
* Make the become attr on the connection public, since it's used outside of the connection
* Logic fix
* Nuke connection testing if it supports specific become methods
* Remove unused vars
* Address rebase issues
* Fix path encoding issue
* Remove unused import
* Various cleanups
* Restore network_cli check in _low_level_execute_command
* type improvements for cliargs_deferred_get and swap shallowcopy to default to False
* minor cleanups
* Allow the su plugin to work, since it doesn't define a prompt the same way
* Fix up ksu become plugin
* Only set prompt if build_become_command was called
* Add helper to assist connection plugins in knowing they need to wait for a prompt
* Fix tests and code expectations
* Doc updates
* Various additional minor cleanups
* Make doas functional
* Don't change connection signature, load become plugin from TaskExecutor
* Remove unused imports
* Add comment about setting the become plugin on the playcontext
* Fix up tests for recent changes
* Support 'Password:' natively for the doas plugin
* Make default prompts raw
* wording cleanups. ci_complete
* Remove unrelated changes
* Address spelling mistake
* Restore removed test, and udpate to use new functionality
* Add changelog fragment
* Don't hard fail in set_attributes_from_cli on missing CLI keys
* Remove unrelated change to loader
* Remove internal deprecated FieldAttributes now
* Emit deprecation warnings now
2019-02-11 17:27:44 +00:00
|
|
|
block = block.filter_tagged_tasks(all_vars)
|
2015-07-29 02:30:59 +00:00
|
|
|
if not block.has_tasks():
|
|
|
|
continue
|
2016-01-25 18:04:52 +00:00
|
|
|
taskmsg += _process_block(block)
|
2015-12-17 21:30:23 +00:00
|
|
|
|
2018-12-18 02:10:59 +00:00
|
|
|
if context.CLIARGS['listtags']:
|
2015-12-17 21:30:23 +00:00
|
|
|
cur_tags = list(mytags.union(all_tags))
|
|
|
|
cur_tags.sort()
|
|
|
|
taskmsg += " TASK TAGS: [%s]\n" % ', '.join(cur_tags)
|
2015-07-29 02:30:59 +00:00
|
|
|
|
2015-11-10 19:40:55 +00:00
|
|
|
display.display(taskmsg)
|
2015-07-29 02:03:50 +00:00
|
|
|
|
2015-04-27 11:31:41 +00:00
|
|
|
return 0
|
2014-11-14 22:14:08 +00:00
|
|
|
else:
|
2015-04-27 11:31:41 +00:00
|
|
|
return results
|
2016-12-13 19:35:15 +00:00
|
|
|
|
2018-12-20 04:45:47 +00:00
|
|
|
@staticmethod
|
|
|
|
def _flush_cache(inventory, variable_manager):
|
2016-12-13 19:35:15 +00:00
|
|
|
for host in inventory.list_hosts():
|
|
|
|
hostname = host.get_name()
|
|
|
|
variable_manager.clear_facts(hostname)
|