o

@&�a`��@s8dd
lZdd
l
Z
dd
lZddlmZ
ddlmZ
ddlmZ
ddl	m
Z

ddl	mZ
ddlm
Z

ddlmZ
dd	lmZ
dd
lmZ
ddlmZ
ddlmZ
dd
lmZ
ddlmZ
ddlmZmZmZm Z m!Z!m"Z"m#Z#
ddl$m%Z%
ddl&m'Z'm(Z(m)Z)
ddl*m+Z+
e
�,e-�
Z.ddddd�Z/dddd�Z0dddd�Z1dddd�Z2ddd d�Z3d!dd"d�Z4d#dd$d%d&d'�Z5d(d)d%d$d%d*�Z6d+d)d,d$d-d.�Z7d/d0d1�Z8d2ed3d4d5d6�Z9d7ed3d4d8d6�Z:d9gd:�
d;d<�Z;d=d>d?d@�Z<dAdBdCdCdDgdEdF�Z=dGdBdCdCg
dHdF�Z>dIdJdKdL�Z?dMdNd1�Z@dOdBdCdCg
dPdF�ZAdQdJdRdL�ZBdSgdT�
dUd<�ZCdVdWd1�ZDdXdYd1�ZEdZd[d1�ZFd\d]d1�ZGd^d_d1�ZHd`dad1�ZIdbdcd1�ZJdddededfdgi
dfdgi
dh�didj�ZKdkdldmgdnd<�ZLdodpd1�ZMdqdrd1�ZNdsddtd�ZOdud)dvdwd�ZPdxdyd1�ZQdzd{d|dL�ZRd}dd~d�ZSddd�d�ZTd�d�g
dBd�d�d��ZUe2e3e:e9e;e5e6e7e=e>e?e@eAeBeCe<eDe8eEeFeGeHeJeIeOePeReSeTeUgZVd�d�d��
ZWGd�d��d�e
�ZXGd�d��d�eX�ZYGd�d��d�eX�ZZGd�d��d�eX�Z[Gd�d��d�eX�Z\Gd�d��d�e\�Z]Gd�d��d�e\�Z^Gd�d��d�e\�Z_Gd�d��d�e\�Z`Gd�d��d�eX�ZaGd�d��d�eX�ZbGd�d��d�ec�ZdGd�d��d�ec�Zed
S)��N)
�Config)
�parse)
�tzlocal)
�six)
�queue)
�BasicCommand)
�
Comparator)
�FileInfoBuilder)
�
FileFormat)
�
FileGenerator)
�FileInfo)
�
create_filter)
�S3TransferHandlerFactory)�find_bucket_key�AppendFilter�find_dest_path_comp_key�human_readable_size�RequestParamsMapper�split_s3_bucket_key�block_unsupported_resources)
�	uni_print)�MissingFileSync�SizeAndLastModifiedSync�	NeverSync)
�transferconfig�	recursive�
store_true�dir_opzUCommand is performed on all files or objects under the specified directory or prefix.)�name�action�dest�	help_textzhuman-readablez-Displays file sizes in human readable format.)rrr!�	summarizez=Displays summary information (number of objects, total size).�dryrunzjDisplays the operations that would be performed using the specified command without actually running them.�quietzEDoes not display the operations performed from the specified command.�forcea<
Deletes all objects in the bucket including the bucket itself. Note that versioned objects will not be deleted in this process which would cause the bucket deletion to fail because the bucket would not be empty. To delete versioned objects use the ``s3api delete-object`` command with the ``--version-id`` parameter.zfollow-symlinksT�follow_symlinksa;
Symbolic links are followed only when uploading to S3 from the local filesystem. Note that S3 does not support symbolic links, so the contents of the link target are uploaded under the name of the link. When neither ``--follow-symlinks`` nor ``--no-follow-symlinks`` is specified, the default is to follow symlinks.)rr�default�
group_namer!zno-follow-symlinks�store_false)rrr r'r(zno-guess-mime-type�guess_mime_typezyDo not try to guess the mime type for uploaded files.  By default the mime type of a file is guessed when it is uploaded.)rrr r'r!zcontent-typezbSpecify an explicit content type for this operation.  This value overrides any guessed mime types.)rr!�exclude�
�filterszQExclude all files or objects from the command that matches the specified pattern.)rr�nargsr r!�includez�Don't exclude files or objects in the command that match the specified pattern. See <a href="http://docs.aws.amazon.com/cli/latest/reference/s3/index.html#use-of-exclude-and-include-filters">Use of Exclude and Include Filters</a> for details.�acl)�privatezpublic-readzpublic-read-writezauthenticated-readz
aws-exec-readzbucket-owner-readzbucket-owner-full-controlzlog-delivery-writea�
Sets the ACL for the object when the command is performed.  If you use this parameter you must have the "s3:PutObjectAcl" permission included in the list of actions for your IAM policy. Only accepts values of ``private``, ``public-read``, ``public-read-write``, ``authenticated-read``, ``aws-exec-read``, ``bucket-owner-read``, ``bucket-owner-full-control`` and ``log-delivery-write``. See <a href="http://docs.aws.amazon.com/AmazonS3/latest/dev/acl-overview.html#canned-acl">Canned ACL</a> for details)r�choicesr!�grants�
+a�<p>Grant specific permissions to individual users or groups. You can supply a list of grants of the form</p><codeblock>--grants Permission=Grantee_Type=Grantee_ID [Permission=Grantee_Type=Grantee_ID ...]</codeblock>To specify the same permission type for multiple grantees, specify the permission as such as <codeblock>--grants Permission=Grantee_Type=Grantee_ID,Grantee_Type=Grantee_ID,...</codeblock>Each value contains the following elements:<ul><li><code>Permission</code> - Specifies the granted permissions, and can be set to read, readacl, writeacl, or full.</li><li><code>Grantee_Type</code> - Specifies how the grantee is to be identified, and can be set to uri or id.</li><li><code>Grantee_ID</code> - Specifies the grantee based on Grantee_Type. The <code>Grantee_ID</code> value can be one of:<ul><li><b>uri</b> - The group's URI. For more information, see <a href="http://docs.aws.amazon.com/AmazonS3/latest/dev/ACLOverview.html#SpecifyingGrantee">Who Is a Grantee?</a></li><li><b>id</b> - The account's canonical ID</li></ul></li></ul>For more information on Amazon S3 access control, see <a href="http://docs.aws.amazon.com/AmazonS3/latest/dev/UsingAuthAccess.html">Access Control</a>)rr.r!�sse�
?�AES256�aws:kmsz�Specifies server-side encryption of the object in S3. Valid values are ``AES256`` and ``aws:kms``. If the parameter is specified but no value is provided, ``AES256`` is used.)rr.�constr2r!zsse-ca
Specifies server-side encryption using customer provided keys of the the object in S3. ``AES256`` is the only valid value. If the parameter is specified but no value is provided, ``AES256`` is used. If you provide this value, ``--sse-c-key`` must be specified as well.z	sse-c-key�blobz�The customer-provided encryption key to use to server-side encrypt the object in S3. If you provide this value, ``--sse-c`` must be specified as well. The key provided should **not** be base64 encoded.)r�
cli_type_namer!zsse-kms-key-idz�The customer-managed AWS Key Management Service (KMS) key ID that should be used to server-side encrypt the object in S3. You should only provide this parameter if you are using a customer managed customer master key (CMK) and not the AWS managed KMS CMK.zsse-c-copy-sourcea�
This parameter should only be specified when copying an S3 object that was encrypted server-side with a customer-provided key. It specifies the algorithm to use when decrypting the source object. ``AES256`` is the only valid value. If the parameter is specified but no value is provided, ``AES256`` is used. If you provide this value, ``--sse-c-copy-source-key`` must be specified as well. zsse-c-copy-source-keya�
This parameter should only be specified when copying an S3 object that was encrypted server-side with a customer-provided key. Specifies the customer-provided encryption key for Amazon S3 to use to decrypt the source object. The encryption key provided must be one that was used when the source object was created. If you provide this value, ``--sse-c-copy-source`` be specified as well. The key provided should **not** be base64 encoded.z
storage-class)�STANDARD�REDUCED_REDUNDANCY�STANDARD_IA�
ONEZONE_IA�INTELLIGENT_TIERING�GLACIER�DEEP_ARCHIVE�
GLACIER_IRz�The type of storage to use for the object. Valid choices are: STANDARD | REDUCED_REDUNDANCY | STANDARD_IA | ONEZONE_IA | INTELLIGENT_TIERING | GLACIER | DEEP_ARCHIVE | GLACIER_IR. Defaults to 'STANDARD'zwebsite-redirectz�If the bucket is configured as a website, redirects requests for this object to another object in the same bucket or to an external URL. Amazon S3 stores the value of this header in the object metadata.z
cache-controlz9Specifies caching behavior along the request/reply chain.zcontent-dispositionz4Specifies presentational information for the object.zcontent-encodingz�Specifies what content encodings have been applied to the object and thus what decoding mechanisms must be applied to obtain the media-type referenced by the Content-Type header field.zcontent-languagezThe language the content is in.z
source-regionaf
When transferring objects from an s3 bucket to an s3 bucket, this specifies the region of the source bucket. Note the region specified by ``--region`` or through configuration of the CLI refers to the region of the destination bucket.  If ``--source-region`` is not specified the region of the source will be the same as the region of the destination bucket.�expiresz=The date and time at which the object is no longer cacheable.�metadata�map�type�string)rG�key�valueaJ
A map of metadata to store with the objects in S3. This will be applied to every object which is part of this request. In a sync, this means that files which haven't changed won't receive the new metadata. When copying between two s3 locations, the metadata-directive argument will default to 'REPLACE' unless otherwise specified.)rr;�schemar!zmetadata-directive�COPY�REPLACEa�Specifies whether the metadata is copied from the source object or replaced with metadata provided when copying S3 objects. Note that if the object is copied over in parts, the source object's metadata will not be copied over, no matter the value for ``--metadata-directive``, and instead the desired metadata values must be specified as parameters on the command line. Valid values are ``COPY`` and ``REPLACE``. If this parameter is not specified, ``COPY`` will be used by default. If ``REPLACE`` is used, the copied object will only have the metadata values that were specified by the CLI command. Note that if you are using any of the following parameters: ``--content-type``, ``content-language``, ``--content-encoding``, ``--content-disposition``, ``--cache-control``, or ``--expires``, you will need to specify ``--metadata-directive REPLACE`` for non-multipart copies if you want the copied objects to have the specified metadata values.zindex-documentaB
A suffix that is appended to a request that is for a directory on the website endpoint (e.g. if the suffix is index.html and you make a request to samplebucket/images/ the data that is returned will be for the object with the key name images/index.html) The suffix must not be empty and must not include a slash character.zerror-documentz9The object key name to use when a 4XX class error occurs.zonly-show-errorszGOnly errors and warnings are displayed. All other output is suppressed.zno-progress�progressz~File transfer progress is not displayed. This flag is only applied when the quiet and only-show-errors flags are not provided.z
expected-sizea/
This argument specifies the expected size of a stream in terms of bytes. Note that this argument is needed only when a stream is being uploaded to s3 and the size is larger than 50GB.  Failure to include this argument under these conditions may result in a failed upload due to too many parts in upload.z	page-size�integerz�The number of results to return in each response to a list operation. The default value is 1000 (the maximum allowed). Using a lower value may help if an operation times out.zignore-glacier-warningsa
Turns off glacier warnings. Warnings about an operation that cannot be performed because it involves copying, downloading, or moving a glacier object will no longer be printed to standard error and will no longer cause the return code of the command to be ``2``.zforce-glacier-transferzMForces a transfer request on all Glacier objects in a sync or recursive copy.z
request-payer�	requestera0
Confirms that the requester knows that they will be charged for the request. Bucket owners need not specify this parameter in their requests. Documentation on downloading objects from requester pays buckets can be found at http://docs.aws.amazon.com/AmazonS3/latest/dev/ObjectsinRequesterPaysBuckets.html)rr2r.r9r!cCs|jd
|
|||d�S)N�s3)�region_name�endpoint_url�verify�config)
�
create_client)�session�regionrSrTrU�rY�F/usr/lib/python3/dist-packages/awscli/customizations/s3/subcommands.py�
get_client�
s


�r[c@seZ
dZd
d�ZdS)�	S3CommandcCst|j
|j|j|j�|_dS�
N)r[�_sessionrXrS�
verify_ssl�client)�self�parsed_args�parsed_globalsrYrYrZ�	_run_main�
s




�zS3Command._run_mainN)�__name__�
__module__�__qualname__rdrYrYrYrZr\�
s
r\cs�eZ
dZd
ZdZdZdddded�eeee	e
gZ�f
d	d
�Z		ddd
�
Z
ddd�
Zdd�Z		ddd�
Zdd�Zdd�Zdd�Zdd�Z�ZS)�ListCommand�lsz�List S3 objects and common prefixes under a prefix or all S3 buckets. Note that the --output and --no-paginate arguments are ignored for this command.z<S3Uri> or NONE�pathsr6�s3://T)rr.r'�positional_arg�synopsiscs�tt
|��|
|�
d
|_d|_d|_d|_|
j|_|
j	}|�
d�
r'|dd�}t|�
\}}|s4|��
n|
j
rB|�|||
j|
j�
n
|�|||
j|
j�
|
jrS|��
|rY|��SdS)NFTr
rk�)�superrhrd�
_empty_result�_at_first_page�_size_accumulator�_total_objects�human_readable�_human_readablerj�
startswithr�_list_all_bucketsr�_list_all_objects_recursive�	page_size�
request_payer�_list_all_objectsr"�_print_summary�_check_no_objects)rarbrc�path�bucketrI�
�	__class__rYrZrd�
s0















�
�

zListCommand._run_mainNc	CsV|j�
d
�
}|
|dd|i
d�}|du
r||d<|jdi|�
�
}|D]}|�|�

q!dS)N�list_objects_v2�
/�PageSize)�Bucket�Prefix�	Delimiter�PaginationConfig�RequestPayerrY�r`�
get_paginator�paginate�
_display_page�	rarrIryrz�	paginator�paging_args�iterator�
response_datarYrYrZr{�
s
�



�zListCommand._list_all_objectscCs
|
�d
g�}|
�dg�}|s|sd|_
dS|D]}|d�d�
}|d}d�dd	�}|d	|d
}	t|	�

q|D]D}
|�|
d�
}|jt|
d�
7_|jd
7_|�	|
d�
}|ri|
d�d�
}
|
d}n|
d}|d	|d	|d}	t|	�

q9d|_
dS)N�CommonPrefixes�ContentsTr�r�����PRE��
 z/
�LastModified�Sizer,�Key����

F)�getrp�split�rjustr�_make_last_mod_strrr�intrs�_make_size_strrq)rar��use_basename�common_prefixes�contents�
common_prefix�prefix_components�prefix�
pre_string�	print_str�content�last_mod_str�size_str�filename_components�filenamerYrYrZr�s6






















�
�


zListCommand._display_pagec
CsJ|j�
�}
|
d
}|D]}|�|d�
}|d|dd}t|�

qdS)N�Buckets�CreationDater��Namer�)r`�list_bucketsr�r)rar��bucketsrr�r�rYrYrZrws







�zListCommand._list_all_bucketsc	CsX|j�
d
�
}|
|d|i
d�}|du
r||d<|jdi|�
�
}|D]	}|j|dd�
q dS)Nr�r�)r�r�r�r�F)
r�rYr�r�rYrYrZrx&s
�



�z'ListCommand._list_all_objects_recursivec


Cs|jr|j
rd
SdS)Nr,r
)rprq�
rarYrYrZr}3s

zListCommand._check_no_objectscCszt|
�
}
|
�
t��
}
t|
j�
t|
j�
�d
�
t|
j�
�d
�
t|
j�
�d
�
t|
j	�
�d
�
t|
j
�
�d
�
f}d|}|�dd�S)zz
        This function creates the last modified time string whenever objects
        or buckets are being listed
        �z%s-%s-%s %s:%s:%s�r�)r�
astimezoner�str�year�month�zfill�day�hour�minute�second�ljust)ra�last_mod�last_mod_tupr�rYrYrZr�:s





�
zListCommand._make_last_mod_strcCs$|jrt
|
�
}nt|
�
}|�d
d�S)zV
        This function creates the size string when objects are being listed.
        �
r�)rurr�r�)ra�sizer�rYrYrZr�Is


zListCommand._make_size_strc
CsZt|j
�
}
td
�dd�|
d�

|jrt|j�
}
nt|j�
}
td�dd�|
d�

dS)zQ
        This function prints a summary of total objects and total bytes
        z
Total Objects: �r�r�zTotal Size: N)r�rsrr�rurrr)rar�rYrYrZr|Ss





zListCommand._print_summary)NN)
T)rerfrg�NAME�DESCRIPTION�USAGE�	RECURSIVE�	PAGE_SIZE�HUMAN_READABLE�	SUMMARIZE�
REQUEST_PAYER�	ARG_TABLErdr{r�rwrxr}r�r�r|�
__classcell__rYrYr�rZrh�
s.



�

�$

�



�

rhcsLeZ
dZd
ZdZdZddded�eegZ�f
dd	�Z	d
d�Z
dd
�Z�ZS)�WebsiteCommand�websitez+Set the website configuration for a bucket.�<S3Uri>rjr,T�rr.rlrmcs@tt
|��|
|�
|�|
jd
�
}|�|
�
}|jj||d�
d
S)Nr
)r��WebsiteConfiguration)ror�rd�_get_bucket_namerj�_build_website_configurationr`�put_bucket_website)rarbrcr�website_configurationr�rYrZrdgs





�zWebsiteCommand._run_maincCs8i}|
jdu
rd
|
ji
|d<|
j
du
rd|
j
i
|d<|S)N�Suffix�
IndexDocumentr��
ErrorDocument)�index_document�error_document)rarb�website_configrYrYrZr�os


�
�z+WebsiteCommand._build_website_configurationcCs8|
�d
�
r|
dd�}
|
�
d�
r|
dd�}
t|
�

|
S)Nrkrnr�r�)rv�endswithr)rar~rYrYrZr�ys






zWebsiteCommand._get_bucket_name)
rerfrgr�r�r��INDEX_DOCUMENT�ERROR_DOCUMENTr�rdr�r�r�rYrYr�rZr�`s




�
�
r�csBeZ
dZd
ZdZdZdded�ddd	d
d�gZ�f
dd
�Z�ZS)�PresignCommand�presignz�Generate a pre-signed URL for an Amazon S3 object. This allows anyone who receives the pre-signed URL to retrieve the S3 object with an HTTP GET request. For sigv4 requests the region needs to be configured explicitly.r�r~T�rrlrmz
expires-inirOzMNumber of seconds until the pre-signed URL expires.  Default is 3600 seconds.)rr'r;r!cshtt
|��|
|�
|
j}|�d
�
r|dd�}t|�
\}}|jjd||d�|
jd�}t	|�

t	d�

dS)Nrkrn�
get_object)r�r�)
�	ExpiresInr�r
)
ror�rdr~rvrr`�generate_presigned_url�
expires_inr)rarbrcr~rrI�urlr�rYrZrd�s









�

zPresignCommand._run_main�	rerfrgr�r�r�r�rdr�rYrYr�rZr��s
�

�
��r�cs,eZ
dZ�f
d
d�Zdd�Zdd�Z�ZS)�S3TransferCommandcs�tt
|��|
|�
|�|
�

|�|
i�}t|j||j�}|�|�

|�	|�

|�
|�

|�|
�

|�|
j
�

t��jdi|j���d
i��
�
}t|j|j|j|�}|��
|��
|��S)NrQrY)ror�rd�_convert_path_args�_build_call_parameters�CommandParametersr�r��
add_region�add_endpoint_url�add_verify_ssl�
add_page_size�	add_pathsrjr�
RuntimeConfig�build_configr^�get_scoped_configr��CommandArchitecture�
parameters�set_clients�create_instructions�run)rarbrc�params�
cmd_params�runtime_config�cmdr�rYrZrd�s*





�








�


�

zS3TransferCommand._run_maincCs"t|
�
�
�D]\}}|||<q|S)
zj
        This takes all of the commands in the name space and puts them
        into a dictionary
        )�vars�items)ra�args�command_paramsrrJrYrYrZr��s


z(S3TransferCommand._build_call_parameterscCspt|
j
t�s|
j
g
|
_
tt|
j
�
�
D]#}|
j
|}t|tj�r5|�t�	��
}|�
d
�
}|�d
�
}||
j
|<qdS)Nzutf-8)�
isinstancerj�list�range�lenr�binary_type�decode�sys�getfilesystemencoding�encode)rarb�
ir~�dec_path�enc_path�new_pathrYrYrZr��s













��z$S3TransferCommand._convert_path_args)rerfrgrdr�r�r�rYrYr�rZr��s
	r�c@s8eZ
dZd
ZdZdZddded�g
eeee	e
gZdS)	�	CpCommand�cpzFCopies a local file or S3 object to another location locally or in S3.�=<LocalPath> <S3Uri> or <S3Uri> <LocalPath> or <S3Uri> <S3Uri>rjr�Tr�N)rerfrgr�r�r��
TRANSFER_ARGS�METADATA�METADATA_DIRECTIVE�
EXPECTED_SIZEr�r�rYrYrYrZr
�s


�
�
�r
c@s6eZ
dZd
ZdZdZddded�g
eeee	gZ
dS)	�	MvCommand�mvzEMoves a local file or S3 object to another location locally or in S3.r
rjr�Tr�N)rerfrgr�r�r�r
r
r
r�r�rYrYrYrZr
�s


�
��r
c	@s8eZ
dZd
ZdZdZddded�eeee	e
eee
g	ZdS)	�	RmCommand�rmzDeletes an S3 object.r�rjr,Tr�N)rerfrgr�r�r��DRYRUN�QUIETr�r��INCLUDE�EXCLUDE�ONLY_SHOW_ERRORSr�r�rYrYrYrZr
�s




�

�r
c@s4eZ
dZd
ZdZdZddded�g
eeegZ	dS)	�SyncCommand�syncz�Syncs directories and S3 prefixes. Recursively copies new and updated files from the source directory to the destination. Only creates folders in the destination if they contain one or more files.r
rjr�Tr�N)
rerfrgr�r�r�r
r
r
r�rYrYrYrZr#
�s


�
��r#
cs6eZ
dZd
ZdZdZdded�g
Z�f
dd�Z�ZS)	�	MbCommand�mbzCreates an S3 bucket.r�r~Tr�c
s�tt
|��|
|�
|
j�d
�
std|j�
�
t|
j�
\}}d|jj	j
i
}d|i
}|jj	j
dkr3||d<z|jjdi|�
�

td|�

WdSt
yc
}
ztd	|
j|ftj�
WYd}~d
Sd}~w
w)Nrk�%s
Error: Invalid argument type�LocationConstraintr�z	us-east-1�CreateBucketConfigurationzmake_bucket: %s
r
zmake_bucket failed: %s %s
r,rY)ror%
rdr~rv�	TypeErrorr�rr`�metarR�
create_bucketr�	Exceptionr
�stderr)rarbrcr�
_�
bucket_configr��
er�rYrZrds(












���zMbCommand._run_mainr�rYrYr�rZr%
�s



r%
cs@eZ
dZd
ZdZdZdded�egZ�f
dd�Zd	d
�Z	�Z
S)�	RbCommand�rbz�Deletes an empty S3 bucket. A bucket must be completely empty of objects and versioned objects before it can be deleted. However, the ``--force`` parameter can be used to delete the non-versioned objects in the bucket before the bucket is deleted.r�r~Tr�c
s�tt
|��|
|�
|
j�d
�
std|j�
�
t|
j�
\}}|r%td|�
�
|
j	r/|�
|
j|�
z|jj|d�

t
d|�

WdSty]
}
zt
d|
j|ftj�
WYd}~dSd}~w
w)	Nrkr'
z5Please specify a valid bucket name only. E.g. s3://%s)
r�zremove_bucket: %s
r
zremove_bucket failed: %s %s
r,)ror2
rdr~rvr*
r�r�
ValueErrorr%�_forcer`�
delete_bucketrr-
r
r.
)rarbrcrrIr1
r�rYrZrd+s,




�







���zRbCommand._run_maincCs,t|j
�
}||
d
g|�}|dkrtd�
�
dS)z'Calls rm --recursive on the given path.z--recursiver
z]remove_bucket failed: Unable to delete all objects in the bucket, bucket will not be deleted.N)r
r^�RuntimeError)rar~rcr
�rcrYrYrZr5
Ds




��zRbCommand._force)rerfrgr�r�r��FORCEr�rdr5
r�rYrYr�rZr2
s
�

�
�r2
c@sZeZ
dZd
Zddd�
Zdd�Zdd�Zd	d
�Zdd�Zd
d�Z	dd�Z
dd�Zdd�ZdS)r�a�

    This class drives the actual command.  A command is performed in two
    steps.  First a list of instructions is generated.  This list of
    instructions identifies which type of components are required based on the
    name of the command and the parameters passed to the command line.  After
    the instructions are generated the second step involves using the
    list of instructions to wire together an assortment of generators to
    perform the command.
    NcCs:|
|_||_
||_g|_||_d|_d|_d|_d|_dSr])	rWr

r��instructions�_runtime_config�	_endpoint�_source_endpoint�_client�_source_client)rarWr

r�r
rYrYrZ�__init__Xs









zCommandArchitecture.__init__c
Cs�d}
|j�
d
�
dkrtdd�
}
t|j|jd|jd|jd|
d�|_t|j|jd|jd|jd|
d�|_|jd	rV|jd
dkrXt|j|jd	d|jd|
d�|_dSdSdS)Nr5r8�s3v4)
�signature_versionrXrSr_)rXrSrTrU�
source_region�
paths_type�s3s3)r�r�rr[rWr>
r?
)ra�
client_configrYrYrZr�cs8









�




�







��
zCommandArchitecture.set_clientsc

Cs^|��r'|j
�d
�

|j�d�
r|j
�d�

|jdkr!|j
�d�

|j
�d�

|j
�d�

dS)aG

        This function creates the instructions based on the command name and
        extra parameters.  Note that all commands must have an s3_handler
        instruction in the instructions and must be at the end of the
        instruction list because it sends the request to S3 and does not
        yield anything.
        �file_generatorr-r$
�
comparator�file_info_builder�
s3_handlerN)�needs_filegeneratorr:
�appendr�r�r

r�rYrYrZr�s







z'CommandArchitecture.create_instructionsc

Cs|jd
S)N�	is_stream)
r�r�rYrYrZrK
�s
z'CommandArchitecture.needs_filegeneratorc
Cspi}
t�|
d
<t
�|
d<t�|
d<|jjd|jd�}|du
r6|D]}|d}|du
r5|j}|d7}||
|<q |
S)	z�Determines the sync strategy for the command.

        It defaults to the default sync strategies but a customizable sync
        strategy can override the default strategy if it returns the instance
        of its self when the event is emitted.
        �"file_at_src_and_dest_sync_strategy�file_not_at_dest_sync_strategy�file_not_at_src_sync_strategyzchoosing-s3-sync-strategy)
r�Nr,�_sync_strategy)rrrrW�emitr��	sync_type)ra�sync_strategies�	responses�response�override_sync_strategyrS
rYrYrZ�choose_sync_strategies�s"�



�





�z*CommandArchitecture.choose_sync_strategiesc

Cs|jd
}
|jd}|jd}t
��|
||j�}t
��||
|j�}ddddd�}t��}||}|j||jd	|jd
|d�}	|jd|jd	|jd
|d�}
|��}|�|�

|�	||�
||	d
<|��}|�|�

||
d
<t
di|	�
�
}
t
di|
�
�
}t|�
\}}t|d
d|||d
d|dd||jdd�g
}t
|j|j|j�}t|j|j�|j|�}|��}i}|jdkr�||g|
|gt|j�
t|j�
gtdi|�
�
g
|g
|g
d�}nV|jdkr�|jdr�|g
|g
d�}nD|jdk�
r|g
|
g
t|j�
g
|g
|g
d�}n-|jdk�
r|g
|
g
t|j�
g
|g
|g
d�}n|jdk�
r/|g
|
g
t|j�
g
|g
|g
d�}|d}|j�
rt|j�d�
}g}||}tt|�
�
D]$}t|�
t|�
k�
r`|�||j|��

�
qI|�||�||�
�

�
qI|}|j�
s7d}|djdk�
r�d}|S|djdk�
r�d}|S) a�
        This function wires together all of the generators and completes
        the command.  First a dictionary is created that is indexed first by
        the command name.  Then using the instruction, another dictionary
        can be indexed to obtain the objects corresponding to the
        particular instruction for that command.  To begin the wiring,
        either a ``FileFormat`` or ``TaskInfo`` object, depending on the
        command, is put into a list.  Then the function enters a while loop
        that pops off an instruction.  It then determines the object needed
        and calls the call function of the object using the list as the input.
        Depending on the number of objects in the input list and the number
        of components in the list corresponding to the instruction, the call
        method of the component can be called two different ways.  If the
        number of inputs is equal to the number of components a 1:1 mapping of
        inputs to components is used when calling the call function.  If the
        there are more inputs than components, then a 2:1 mapping of inputs to
        components is used where the component call method takes two inputs
        instead of one.  Whatever files are yielded from the call function
        is appended to a list and used as the input for the next repetition
        of the while loop until there are no more instructions.
        �srcr rD
�upload�copy�download�delete)�locals3rE
�s3localrQr&ry)r`�operation_namer&ry�result_queue��request_parametersr~rGT)rY
r �compare_key�src_type�	dest_typer`
r`rM
r$
)�setuprG
r-rH
rI
rJ
r
rM
)rg
rJ
)rg
rG
r-rI
rJ
r
r
rg
r
r,r�NrY)r�r
�formatr�Queuer?
r>
�/_get_file_generator_request_parameters_skeleton�_map_request_payer_params�_map_sse_c_paramsrrrr	rr;
rX
r

r
rr:
�popr
r	
rL
�call�num_tasks_failed�num_tasks_warned)rarY
r rD
�files�	rev_files�cmd_translationra
r`
�fgen_kwargs�rgen_kwargs�fgen_request_parameters�rgen_request_parametersrG
�
rev_generator�stream_dest_path�stream_compare_key�stream_file_inforI
�s3_transfer_handlerrT
�command_dict�instruction�	file_list�
componentsr
r8
rYrYrZr��s�









�



�


��


�













�
�
��




�
�

�

�





�





�





�







�

�

zCommandArchitecture.runc

Csiiid
�S)N)�
HeadObject�ListObjects�
ListObjectsV2rYr�rYrYrZrj
;s

�zCCommandArchitecture._get_file_generator_request_parameters_skeletoncCs<t�
|
d
d|j�d�
i
�
t�|
dd|j�d�
i
�
dS)Nr�
rzr�
)r�map_head_object_paramsr�r��map_list_objects_v2_params)rarc
rYrYrZrk
Bs


��

��z-CommandArchitecture._map_request_payer_paramscCsHt�
|
d
|j�
|dkr"t�
|
d
|j�d�
|j�d�
d��
dSdS)Nr�
rE
�sse_c_copy_source�sse_c_copy_source_key)�sse_c�	sse_c_key)rr�
r�r�)rarc
rD
rYrYrZrl
Ns

�





���z%CommandArchitecture._map_sse_c_paramsr])
rerfrg�__doc__r@
r�r�rK
rX
r�rj
rk
rl
rYrYrYrZr�Ns

	r�c@s�eZ
dZd
Zdd�Zdd�Zdd�Zdd	�Zd
d�Zdd
�Z	dd�Z
dd�Zdd�Zdd�Z
dd�Zdd�Zd dd�
Zdd�ZdS)!r�z{
    This class is used to do some initial error based on the
    parameters and arguments passed to the command line.
    cCs�|
|_||_
||_d
|v
rd|j
d
<d|v
rd|j
d<d|v
r$d|j
d<|jdvr.d|j
d
<|jdkr:d|j
d	<dSd|j
d	<dS)
a!

        Stores command name and parameters.  Ensures that the ``dir_op`` flag
        is true if a certain command is being used.

        :param cmd: The name of the command, e.g. "rm".
        :param parameters: A dictionary of parameters.
        :param usage: A usage string

        rFr&TrC
N)r$
r&
r3
r
�is_move)r

r��usage)rar

r�r�
rYrYrZr@
es


















zCommandParameters.__init__cCsx|�|
�

|�
|
�

|
d
}||jd<t|
�
dkr!|
d|jd<n
t|
�
dkr.|
d
|jd<|��
|��
|��
dS)a

        Reformats the parameters dictionary by including a key and
        value for the source and the destination.  If a destination is
        not used the destination is the same as the source to ensure
        the destination always have some value.
        r
rY
r�r,r N)�check_path_type�_normalize_s3_trailing_slashr�r	
�_validate_streaming_paths�_validate_path_args�_validate_sse_c_args)rarj�src_pathrYrYrZr�s












zCommandParameters.add_pathsc

Csjd
|jd<|jddks|jddkr3|j
dks|j�d�
r"td�
�
d	|jd<d
|jd<d	|jd
<dSdS)NFrM
rY
�
-r r
rzEStreaming currently is only compatible with non-recursive cp commandsT�only_show_errors)r�r

r�r4
r�rYrYrZr�
�s





�



�z+CommandParameters._validate_streaming_pathsc
Cs�|j}
|j
d
kr|�|
d|
d�rtd|
d|
df�
�
d|
dkr:|
ds:tj�|
d�
s8td|
d�
�
dSd	|
dkrU|
d
rWtj�|
d�
sYt�|
d�

dSdSdSdS)Nr
rY
r z)Cannot mv a file onto itself: '%s' - '%s'r^
rD
rM
z)The user-provided path %s does not exist.r_
r)	r�r

�
_same_pathr4
�osr~�existsr7
�makedirs)rar�rYrYrZr�
�s$


�



���

�
z%CommandParameters._validate_path_argscCsJ|jd
dks	dS|
|krdS|�
d�
r#tj�|
�
}|
tj�||�kSdS)NrD
rE
FTr�)r�r�r�
r~�basename�join)rarY
r �src_baserYrYrZr�
�s







�zCommandParameters._same_pathcCsRt|
�
D]"\}}|�
d
�
r&t|dd��
\}}|s&|�d�
s&|d7}||
|<qdS)Nrkrnr�)�	enumeratervrr�)rarjr
r~rrIrYrYrZr�
�s





��z.CommandParameters._normalize_s3_trailing_slashcCs�gd
�
gd
�
gd
�
gd�
ggd�}d}d|j|j
f}tt|
�
�
D]}|
|�d�
r/|d}q!|d}q!|j||vrB||jd	<dStd
|�
�
)zn
        This initial check ensures that the path types for the specified
        command is correct.
        )r
r$
r
)r&
r3
r
)rE
r_
r^
rQ�local�
locallocalrb
zusage: aws s3 %s %srkrQr�
rD
r'
N)r

r�
r
r	
rvr�r*
)rarj�
template_typerD
r�
r
rYrYrZr�
�s"



�

�





z!CommandParameters.check_path_typecC�|
j|j
d
<dS)NrX)rXr��rarcrYrYrZr���
zCommandParameters.add_regioncCs*d
|
vrt|
d
�|j
d
<dSd|j
d
<dS)z6
        Adds endpoint_url to the parameters.
        rSN��getattrr�r�
rYrYrZr��s


�z"CommandParameters.add_endpoint_urlcCr�
)Nr_)r_r�r�
rYrYrZr��r�
z CommandParameters.add_verify_sslcCst|
d
d�|j
d
<dS)Nryr�
)rarbrYrYrZr��s
zCommandParameters.add_page_sizec

Cs|��
|�d
�

|�
�
dS)Nr�
)�_validate_sse_c_arg�%_validate_sse_c_copy_source_for_pathsr�rYrYrZr�
�s



z&CommandParameters._validate_sse_c_argsr�
cCs�|
d
}d|
�dd�}d|�dd�}|j
�|
�
r(|j
�|�
s(td||f�
�
|j
�|�
r<|j
�|
�
s>td||f�
�
dSdS)N�_keyz--r/
r�
z1It %s is specified, %s must be specified as well.)�replacer�r�r4
)ra�
sse_c_type�sse_c_key_type�sse_c_type_param�sse_c_key_type_paramrYrYrZr�
�s&







��



���
z%CommandParameters._validate_sse_c_argc

Cs*|j�
d
�
r|jddkrtd�
�
dSdS)Nr�
rD
rE
z:--sse-c-copy-source is only supported for copy operations.)r�r�r4
r�rYrYrZr�
s



��
z7CommandParameters._validate_sse_c_copy_source_for_pathsN)
r�
)rerfrgr�
r@
r�r�
r�
r�
r�
r�
r�r�r�r�r�
r�
r�
rYrYrYrZr�`s 
	

r�r])fr�
�loggingr
�botocore.clientr�dateutil.parserr�dateutil.tzr�
awscli.compatrr�awscli.customizations.commandsr�#awscli.customizations.s3.comparatorr�(awscli.customizations.s3.fileinfobuilderr	�#awscli.customizations.s3.fileformatr
�&awscli.customizations.s3.filegeneratorr�!awscli.customizations.s3.fileinfor� awscli.customizations.s3.filtersr
�"awscli.customizations.s3.s3handlerr�awscli.customizations.s3.utilsrrrrrrr�awscli.customizations.utilsr�*awscli.customizations.s3.syncstrategy.baserrr�awscli.customizations.s3r�	getLoggerre�LOGGERr�r�r�r
r
r9
�FOLLOW_SYMLINKS�NO_FOLLOW_SYMLINKS�NO_GUESS_MIME_TYPE�CONTENT_TYPEr!
r 
�ACL�GRANTS�SSE�SSE_C�	SSE_C_KEY�SSE_KMS_KEY_ID�SSE_C_COPY_SOURCE�SSE_C_COPY_SOURCE_KEY�
STORAGE_CLASS�WEBSITE_REDIRECT�
CACHE_CONTROL�CONTENT_DISPOSITION�CONTENT_ENCODING�CONTENT_LANGUAGE�
SOURCE_REGION�EXPIRESr
r
r�r�r"
�NO_PROGRESSr
r��IGNORE_GLACIER_WARNINGS�FORCE_GLACIER_TRANSFERr�r
r[r\rhr�r�r�r
r
r
r#
r%
r2
�objectr�r�rYrYrYrZ�<module>
sj













$


�
�����

�

�
��
�
�

��
�
�
��
��
��	���
���

������

�	�
���	
�










�
(!+
	
0