Amazon S3: Get Objects From Bucket

Description

This step retrieves a list of objects (files and folders) from an S3 bucket, returning up to 1,000 objects per call. For each object, it returns the name, ETag, size, last modified date, and storage class. The user must have Read permission on the bucket. Use this step in workflows that audit bucket contents, check for new files before processing, or generate inventory reports of objects stored in S3.

Notes:

• To get the list of objects from a bucket a user must have Read permission on the bucket.
• Provide access (whitelist) to the following URLs through your firewall and network, https://amazonaws.com/.

Reference

REST API: Get Objects From Bucket

Configurations

Field Name	Description
Step Name	Specify a unique name for the step.
Connection tab:	For the Amazone S3 connection fields details, click Common Tab: Connection Fields
INPUT tab:	Input fields
Bucket Name	Specify the name of the S3 bucket to get objects. The data type is String. This field is mandatory.
Get	Click the button to populate the list of available Buckets.
OUTPUT tab:	Output fields
Object Name	Specify the output variable name in the field. The default output variable name: ObjectName The name of the Object (Key) in the bucket, returns the names of files and folders.
ETag	Specify the output variable name in the field. The default output variable name: ETag The ETag (entity tag) is the hash of an object.
Object Size	Specify the output variable name in the field. The default output variable name: ObjectSize. The object size returns the size of each object in the bucket.
Last Modified	Specify the output variable name in the field. The default output variable name: LastModified. The last modified is the date of the modification of the objects.
Storage Class	Specify the output variable name in the field. The default output variable name: StorageClass. It returns the Storage class of the object in which that object is stored in. Storage classes offer higher durability.