Quantum-CLI: A powerful CLI to build, run, and test Quantum Machines.

Execute Your Workflow in a Loop with QuantumDataLytica

QuantumLoop is a powerful enhancement to our no-code data automation platform.

QuantumDataLytica vs Traditional ETL Tools: Accelerate Your Data Integration Without Coding

Traditional Extract, Transform, Load (ETL) tools have long been at the core of data integration practices.

QuantumDataLytica: The No-Code Alternative to Traditional ETL

For years, ETL (Extract, Transform, Load) solutions have been the cornerstone of data integration.

| Marketplace | S3 Bucket

S3 Bucket

1.0.4 0
This S3 Bucket machine performs two main tasks: reading files from an S3 bucket and uploading files to it, based on the user-provided configuration and file data. And if user in write mode then it returning the S3 object URL and file name, with optional folder placement within the bucket.

Free

Main Banner
Machine Overview
  • Machine Name : S3 Bucket
  • Title : AWS S3 File Management: Upload and Retrieve Files
  • Short Description :
    This S3 Bucket machine performs two main tasks: reading files from an S3 bucket and uploading files to it, based on the user-provided configuration and file data. And if user in write mode then it returning the S3 object URL and file name, with optional folder placement within the bucket.
  • Detail Description : The S3 Bucket machine is designed to interact with Amazon S3, allowing users to either read or upload files based on their configuration. Users can specify a mode ('read' or 'write') to determine the operation. If the mode is 'read', the machine retrieves files from the specified S3 bucket and folder, processes them, and deletes them after handling. If the mode is 'write', it uploads files to the S3 bucket by encoding them in Base64 and providing necessary metadata, including file names and content types. The machine uses user-provided AWS credentials (access key, secret key, and region) to authenticate and access the bucket. The system ensures that any error or failure is logged and handled. This process is part of a broader workflow, which involves getting file data, performing operations, and passing the results to the next step via callbacks.
  • Machine Document : Download
Classification
  • Industry : IT
  • Category : Database
  • Sub Category : -
Compatibility and Dependencies
  • Dependent Machines : -
  • Compatible Machines : -
  • Version : 1.0.4
Specifications
  • Input Specification : Download

    This input data get the necessary AWS credentials, bucket details, and optional folder information for reading from or uploading files to an S3 bucket.

    • Mode (String): Specifies the mode of operation for file access. Use 'read' for reading files from the S3 bucket or 'write' for uploading files to the S3 bucket.
    • AWS Access Key (String): AWS authentication key for accessing S3 services.
    • AWS Secret Key (String): AWS secret key used for secure S3 authentication.
    • AWS Region (String): AWS region where the S3 bucket is located.
    • S3 Bucket Name (String): The name of the S3 bucket for file storage.
    • S3 Folder (String): Folder name within the S3 bucket for storing files.
    • File Names (Array[String]): A list of file names that you want to read from the S3 bucket. You can provide multiple file names in this list. The file names should be in the following format: ['File 1', 'File 2', 'File 3'].
  • Output Specification : Download

    The output provides the URLs and file paths of uploaded files (for write mode) or retrieved files (for read mode), helping identify and access files stored in the S3 bucket.

    • Mode (String): Specifies the mode of operation for file access. 'write' is used for uploading files, and 'read' is used for retrieving files from the S3 bucket.
    • (Write) Uploaded Data (Array): A list of data entries for files that have been uploaded in 'write' mode. Each entry in the array represents an uploaded file.
    • (Write) S3 Object Url (String): The URL that provides access to the file stored in the S3 bucket after uploading.
    • (Write) File Name (String): The name of the file uploaded or retrieved from the S3 bucket.
    • (Read) Get File (Array): A list of data entries for files that have been retrieved in 'read' mode. Each entry in the array represents a retrieved file.
    • (Read) File Path (String): The file path where the file is located on the that path after being retrieved from the S3 bucket.
    • (Read) File Name (String): The name of the file retrieved from the S3 bucket in 'read' mode.
Infrastructure Requirement
  • OS Requirement : Linux
  • CPU : 500m
  • Cloud : AWS
  • RAM : 256Mi
Usage Stats
  • Total OnBoarded : -
  • Active OnBoarding : -
Parameter Name Type Description
Mode Dropdown Single Select
Aws Access Key Text Box
Aws Secret Key Text Box
Aws Region Text Box
S3 Bucket Name Text Box
S3 Folder Text Box
File Names Json

View Similar

noDataFound

Data Not Found

May 26, 2025

Code update


April 9, 2025

--

April 9, 2025

--

April 9, 2025

Update in Project file.


March 17, 2025

remove print statement.


March 17, 2025

--

February 15, 2025

--

View Similar

noDataFound

Data Not Found

Total Reviews
0
Total Ratings
0
Average Rating
0
Star Rating
5
0
4
0
3
0
2
0
1
0

View Similar

noDataFound

Data Not Found

If the file upload fails due to issues like incorrect AWS credentials, network failure, or invalid bucket permissions, the machine logs an error message and returns an error response. Users can check the logs for specific error details and troubleshoot by verifying their AWS credentials, IAM permissions, and network connectivity.

Yes! The machine allows specifying a prefix (folder path) for stored files using the s3_object_key_prefix input parameter. For example, if you set s3_object_key_prefix to 'processed-data/' and upload a file named report.csv, it will be stored in S3 as processed-data/report.csv.

After a successful upload, the machine returns the S3 object URL in the response data. You can use this URL to access the uploaded file directly or pass it to another machine in the workflow for further processing. The URL format typically looks like: https://.s3..amazonaws.com/

If incorrect AWS credentials or region are provided, the machine will fail to initialize the S3 client. An error message will be logged, and no further operations will be performed.

If the file does not exist, the machine will log a 404 error indicating that the object was not found. The process will continue for any other files, and the error will be recorded in the logs.

View Similar

noDataFound

Data Not Found

Specifications
  • Input Specification : Download

    This input data get the necessary AWS credentials, bucket details, and optional folder information for reading from or uploading files to an S3 bucket.

    • Mode (String): Specifies the mode of operation for file access. Use 'read' for reading files from the S3 bucket or 'write' for uploading files to the S3 bucket.
    • AWS Access Key (String): AWS authentication key for accessing S3 services.
    • AWS Secret Key (String): AWS secret key used for secure S3 authentication.
    • AWS Region (String): AWS region where the S3 bucket is located.
    • S3 Bucket Name (String): The name of the S3 bucket for file storage.
    • S3 Folder (String): Folder name within the S3 bucket for storing files.
    • File Names (Array[String]): A list of file names that you want to read from the S3 bucket. You can provide multiple file names in this list. The file names should be in the following format: ['File 1', 'File 2', 'File 3'].
  • Output Specification : Download

    The output provides the URLs and file paths of uploaded files (for write mode) or retrieved files (for read mode), helping identify and access files stored in the S3 bucket.

    • Mode (String): Specifies the mode of operation for file access. 'write' is used for uploading files, and 'read' is used for retrieving files from the S3 bucket.
    • (Write) Uploaded Data (Array): A list of data entries for files that have been uploaded in 'write' mode. Each entry in the array represents an uploaded file.
    • (Write) S3 Object Url (String): The URL that provides access to the file stored in the S3 bucket after uploading.
    • (Write) File Name (String): The name of the file uploaded or retrieved from the S3 bucket.
    • (Read) Get File (Array): A list of data entries for files that have been retrieved in 'read' mode. Each entry in the array represents a retrieved file.
    • (Read) File Path (String): The file path where the file is located on the that path after being retrieved from the S3 bucket.
    • (Read) File Name (String): The name of the file retrieved from the S3 bucket in 'read' mode.

Updates and Community

Machine Developer

BotCraft Engineers
  • Last Updated
  • May 26, 2025
  • Version
  • 1.0.4
Version History

Statistics

Total Workflows
0
Active Workflows
0
Success Rate
N/A
Last Used in Workflow
N/A

Categories

Database

Support

Average Response Time 8AM-8PM