Shulou(Shulou.com)05/31 Report--

This article mainly talks about "what is the method of lifecycle functional testing". Interested friends may wish to have a look at it. The method introduced in this paper is simple, fast and practical. Next, let the editor take you to learn "what is the method of lifecycle functional testing?"

Lifecycle function test

Function description:

1. Lifecycle is currently supported from version k, and only Expired is supported, which removes expired objects.

The modification operation of lifecycle cannot be carried out under 2.AWS4 authentication, and 501errors will occur at the HTTP level.

3.boto and boto3 can support get and put operations under AWS2 authentication, and testing functions are available.

4. The test found that the get_lifecycle operation is performed on the bucket first. If 404 is returned, the content of the corresponding response is incomplete, and the response in the subsequent request request will be contaminated.

Get_bucket_lifecycle test case boto3 use case import boto3from botocore.client import Configaws_access_key_id =''aws_secret_access_key =' 'bucket_name =' test1'# aws4s3 = boto3.client ('S3 testing, region_name='CN', use_ssl=False, endpoint_url=' http://ceph.work', aws_access_key_id=aws_access_key_id Aws_secret_access_key=aws_secret_access_key, config=Config (signature_version='s3v4', S3 = {'addressing_style':' virtual'}) # aws2s3 = boto3.client ('S3, region_name=None, use_ssl=False, endpoint_url=' http://ceph.work',) Aws_access_key_id=aws_access_key_id, aws_secret_access_key=aws_secret_access_key Config=Config (S3 = {'addressing_style':' virtual'}) print s3.get_bucket_lifecycle (Bucket=bucket_name) print s3.get_bucket_lifecycle_configuration (Bucket=bucket_name) boto use case from boto.s3.connection import S3Connectionimport boto# import os# os.environ ['S3 installed SIGV4'] = 'True' # use aws4access_key =' 'secret_key =' 'host =' ceph.work'bucket_name = 'test1'conn = boto.connect _ S3 (aws_access_key_id=access_key Aws_secret_access_key=secret_key, host=host, is_secure=False, calling_format=boto.s3.connection.SubdomainCallingFormat (), validate_certs=True ) bucket = conn.get_bucket (bucket_name) config = bucket.get_lifecycle_config () for i in config: print i.endElement print i.expiration print i.id print i.startElement print i.to_xml () put_bucket_lifecycle test case boto3 use case import boto3from botocore.client import Configimport datetimeaws_access_key_id =''aws_secret_access_key =' 'bucket_name =' test1'#aws2 available S3 = boto3.client ('s3clients, region_name=None Use_ssl=False, endpoint_url=' http://ceph.work', aws_access_key_id=aws_access_key_id, aws_secret_access_key=aws_secret_access_key, config=Config (S3 = {'addressing_style':' virtual'})) # aws4 error Return 501s3 = boto3.client ('s 3 seconds, region_name='CN', use_ssl=False, endpoint_url=' http://ceph.work', aws_access_key_id=aws_access_key_id, aws_secret_access_key=aws_secret_access_key, config=Config (signature_version='s3v4') S3 = {'addressing_style':' virtual'}) print s3.put_bucket_lifecycle (Bucket=bucket_name, LifecycleConfiguration= {'Rules': [{' Expiration': {'Date': datetime.datetime (2015, 3, 15),' Days': 123 'ExpiredObjectDeleteMarker': True | False},' ID': 'demo1',' Prefix':'/ abc', 'Status':' Enabled', 'Transition': {' Date': datetime.datetime (2017, 3, 15), 'Days': 123 'StorageClass':' STANDARD_IA'}, 'NoncurrentVersionTransition': {' NoncurrentDays': 123, 'StorageClass':' STANDARD_IA'}, 'NoncurrentVersionExpiration': {' NoncurrentDays': 123} 'AbortIncompleteMultipartUpload': {' DaysAfterInitiation': 123}},]})

The 501 error indicates that the official part of the feature has not been completed yet.

NotImplementedtx000000000000000000056-0058d0d70b-10b2-default10b2-default-defaultboto use case from boto.s3.connection import S3Connectionimport botoimport boto.s3.lifecycleimport os# os.environ ['S3The user SIGV4'] = 'True' # use aws4from boto.s3.lifecycleimport (Lifecycle, Expiration,) access_key=' 'secret_key =' 'host=' ceph.work'bucket_name = 'test1'conn = boto.connect_s3 (aws_access_key_id=access_key, aws_secret_access_key=secret_key, host=host) Is_secure=False, calling_format=boto.s3.connection.SubdomainCallingFormat (), validate_certs=True,) bucket = conn.get_bucket (bucket_name) # type 1lifecycle_config = boto.s3.lifecycle.Lifecycle () lifecycle_config.add_rule ('lc_rule_1',' del/', 'Enabled', 1) lifecycle_config.add_rule (' lc_rule_2','/ abc', 'Enabled' 10) bucket.configure_lifecycle (lifecycle_config) # type 2lifecycle = Lifecycle () lifecycle.add_rule ('lc_rule_1', prefix='del/', status='Enable', expiration=Expiration (days=1)) lifecycle.add_rule (' lc_rule_2', prefix='data/', status='Enabled') Bugfrom boto.s3.connection import S3Connectionimport botoaccess_key =''secret_key =' 'host=' ceph.work'bucket_name = 'test1'conn = boto.connect_s3 (aws_access_key_id=access_key, aws_secret_access_key=secret_key, host=host, is_secure=False, calling_format=boto.s3.connection.SubdomainCallingFormat (), validate_certs=True) of expiration=Expiration (days=10) bucket.configure_lifecycle (lifecycle) get_bucket_lifecycled ) bucket = conn.get_bucket (bucket_name) print bucket.get_lifecycle_config () # lifecycle of bucket is not set Return 404 with the following error

Error prompt

Traceback (most recent call last): File "/ Users/Diluga/SourceCode/PycharmProjects/kv_server/boto_demo/demo1.py", line 56, in print bucket.get_lifecycle_config () File "/ Users/Diluga/lwc/lib/python2.7/site-packages/boto/s3/bucket.py", line 1387, in get_lifecycle_config response.status, response.reason, body) boto.exception.S3ResponseError: S3ResponseError: 404 Not FoundNoSuchLifecycleConfigurationsnappy-testtx00000000000000000008f-0058d0dc3b-10b2-default10b2-default-default#xml is not finished The response returned by the next request request will be contaminated

S3cmd also reported an error.

DEBUG: signature-v4 headers: {'xmuramzlycontentlysha256colors: 'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855,' Authorization': 'AWS4-HMAC-SHA256 Credential=W7L3YC842AGADI1T8BV9/20170321/CN/s3/aws4_request,SignedHeaders=host;x-amz-content-sha256 XmuramzMaidated0a6ca337af207d00d170f5b999782f49928b01395494c96d3dd3f88d987c7 DEBUG: '20170321T075840Z'} DEBUG: Processing request, please wait...DEBUG: get_hostname (snappy-test): snappy-test.ceph.workDEBUG: ConnMan.get (): re-using connection: http://snappy-test.ceph.work#2DEBUG: format_uri (): /? lifecycleDEBUG: Sending request method_string='GET', uri='/?lifecycle', headers= {' xshasha256: e3b0c44298fcc149afbf4c8996fb924ae41e4649b934ca49991b7852b855' 'Authorization': 'AWS4-HMAC-SHA256 Credential=W7L3YC842AGADI1T8BV9/20170321/CN/s3/aws4_request,SignedHeaders=host X-amz-content-sha256 DEBUG: '20170321T075840Z'}, body= (0 bytes) DEBUG: Response: {' status': 404, 'headers': {' date': 'Tue, 21 Mar 2017 07:58:40 GMT',' content-length': '237 bytes',' XmuramzusrequestReceiving: 'tx000000000000000000092-0058d0dd30-10b2 requestReciprocity:' tx000000000000000000092-0058d0dd30-10bUR 'accept-ranges':' bytes'} 'reason':' Not Found', 'data':' NoSuchLifecycleConfigurationsnappy-testtx000000000000000000092-0058d0dd30-10b2Merdefault10b2Merdefault`} DEBUG: ConnMan.put (): connection put back to pool (http://snappy-test.ceph.work#3)DEBUG: S3Error: 404 (Not Found) DEBUG: HttpHeader: date: Tue 21 Mar 2017 07:58:40 GMTDEBUG: HttpHeader: content-length: 237DEBUG: HttpHeader: x-amz-request-id: tx000000000000000000092-0058d0dd30-10b2-defaultDEBUG: HttpHeader: content-type: application/xmlDEBUG: HttpHeader: accept-ranges: bytesDEBUG: ErrorXML: Code: 'NoSuchLifecycleConfiguration'DEBUG: ErrorXML: BucketName:' snappy-test'DEBUG: ErrorXML: RequestId: 'tx000000000000000000092-0058d0dd30-10b2-default'DEBUG: ErrorXML: HostId:' 10b2-default-default'DEBUG: Could not get /? lifecycle-lifecycle probably not configured for this bucket Expiration Rule: noneDEBUG: CreateRequest: resource [uri] = /? aclDEBUG: Using signature v4DEBUG: get_hostname (snappy-test): snappy-test.ceph.workDEBUG: canonical_headers = host:snappy-test.ceph.workx-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855x-amz-date:20170321T075840ZDEBUG: Canonical Request:GET/acl=host:snappy-test.ceph.workx-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855x-amz-date:20170321T075840Zhost XmuramzLectione3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 Movie Debug: signature-v4 headers: {'xwayamzshasha256hands:' e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca49599b785b855 XmuramzWhat date: '20170321T075905a33ddZ'} DEBUG: Processing request, please wait...DEBUG: get_hostname (snappy-test): snappy-test.ceph.workDEBUG: ConnMan.get (): re-using connection: http://snappy-test.ceph.work#3DEBUG: format_uri (): /? aclDEBUG: Sending request method_string='GET', uri='/?acl', headers= {' color xamamzshasha256: 'e3b0c44298fc1c149afbf4c8996fb924ae41e4649b934ca495991b785b855' 'Authorization': 'AWS4-HMAC-SHA256 Credential=W7L3YC842AGADI1T8BV9/20170321/CN/s3/aws4_request,SignedHeaders=host X-amz-content-sha256 XmuramzAfter Signaturements 03386b844b8600b0cdd28d38d8a6e528fa75385cab056771f9148266905a33ddAfter: '20170321T075840Z'}, body= (0 bytes) DEBUG: Response: {' status': 200, 'headers': {},' reason':', 'data':' HTTP/1.1 200 OK\ r\ nx-amz-request-id: tx000000000000000000093-0058d0dd30-10b2-default\ r\ nContent-Type: application/xml\ r\ nContent-Length: 441\ r\ nDate: Tue 21 Mar 200 07:58:40 GMT\ r\ n\ r\ nu-gfn2636u-gfn2636u-gfn2636u-gfn2636FULL_CONTROL'} DEBUG: ConnMan.put (): connection put back to pool (http://snappy-test.ceph.work#4)ERROR: Error parsing xml: not well-formed (invalid token): line 1, column 101ERROR: HTTP/1.1 2017 OKx-amz-request-id: tx000000000000000000093-0058d0dd30-10b2-defaultContent-Type: application/xmlContent-Length: 441Date: Tue 21 Mar 2017 07:58:40 GMTu-gfn2636u-gfn2636u-gfn2636u-gfn2636FULL_CONTROL will be here I believe that you have a deeper understanding of "what is the functional testing method of lifecycle", so you might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.