How to upload files to S3 bucket from url directly

✔ Recommended Answer

Have a look at the Twilio Function below, it should point you in the right direction.

It was derived from this Twilio Blog:

Encrypting and Storing Twilio Flex Recordings Off-site

const axios = require('axios');let AWS = require('aws-sdk');const S3UploadStream = require('s3-upload-stream');exports.handler = async function(context, event, callback) {// Set the regionAWS.config.update({region: 'us-west-2'});AWS.config.update({ accessKeyId: context.AWSaccessKeyId, secretAccessKey: context.AWSsecretAccessKey });// The name of the bucket that you have createdconst BUCKET_NAME = 'winston';const fileUrl = "https://a.b.twil.io/assets/KittehWinston.jpg";const fileName = "winston.jpg";const s3Stream = S3UploadStream(new AWS.S3());// call S3 to retrieve upload file to specified bucketlet upload = s3Stream.upload({Bucket: BUCKET_NAME, Key: fileName, ContentType: 'image/jpeg', ACL: 'public-read'   });const fileUpload = await uploadFile(fileUrl, upload).then(result => callback(null, `success: ${JSON.stringify(result)}`)).catch(err => callback(err.message));async function uploadFile (url, upload) {    const response = await axios({      url,      method: 'GET',      responseType: 'stream'    })      response.data.pipe(upload);      return new Promise((resolve, reject) => {      upload.on('uploaded', resolve)      upload.on('error', reject)    })  }};

Source: stackoverflow.com

Answered By: Alan

Method #2

To upload files to an Amazon S3 bucket from a URL directly, you can use the AWS SDK for PHP. Here's an example of how to do it:

php
use Aws\S3\S3Client;

// Initialize an S3 client
$client = new S3Client([
    'version' => 'latest',
    'region' => 'your_bucket_region',
    'credentials' => [
        'key' => 'your_access_key',
        'secret' => 'your_secret_key',
    ],
]);

// Set the URL of the file to upload
$fileUrl = 'https://example.com/image.jpg';

// Set the name of the file in the S3 bucket
$fileName = 'image.jpg';

// Upload the file from the URL to the S3 bucket
$result = $client->putObject([
    'Bucket' => 'your_bucket_name',
    'Key' => $fileName,
    'Body' => fopen($fileUrl, 'r'),
    'ACL' => 'public-read', // Set the object ACL
]);

// Get the URL of the uploaded file
$fileUrl = $result['ObjectURL'];

In this example, we first initialize an S3 client with the appropriate credentials and region. We then set the URL of the file to upload and the desired file name in the S3 bucket. Next, we use the putObject method of the S3 client to upload the file from the URL to the S3 bucket, setting the ACL of the uploaded object to public-read. Finally, we retrieve the URL of the uploaded file.

Note that the putObject method takes an input stream as its Body parameter. In this example, we pass the result of fopen($fileUrl, 'r') to the Body parameter to open a read-only stream to the file at the specified URL. This approach avoids loading the entire file into memory at once, which could cause memory issues for large files.

Comments

Post a Comment

Most Popular

Remove Unicode Zero Width Space PHP

✔ Recommended Answer This: $newBody = str_replace("​", "", $newBody); presumes the text is HTML entity encoded. This: $newBody = str_replace("\xE2\x80\x8C", "", $newBody); should work if the offending characters are not encoded, but matches the wrong character (0xe2808c). To match the same character as #8203; you need 0xe2808b: $newBody = str_replace("\xE2\x80\x8B", "", $newBody); Source: stackoverflow.com Answered By: Jef Method #2 To remove Unicode zero width space (ZWSP) from a string in PHP, you can use the str_replace() function to replace the ZWSP character with an empty string. Here's an example: php $str = "Hello​ World" ; // Contains ZWSP after "Hello" // Replace ZWSP with an empty string $str = str_replace ( "\u{200B}" , "" , $str ); echo $str ; // Outputs "Hello World" without ZWSP In this example, the str_replace() functi
Read more

PhpStorm, return value is expected to be 'A', 'object' returned

Image
✔ Recommended Answer Has to be because object can be ANY class instance, even B etc. You can annotate the create() method with generics PHPDoc to tell that the return type will be the same as the input parameter class string. It gives more context info to the IDE. /** * @template T * * @param string $class * @return T */ private function create(string $class) : object { return new $class(); } P.S. Instead of create('B'); better use create(B::class) . This way the IDE can track the usages of that class for refactoring/search purposes etc. Source: stackoverflow.com Answered By: LazyOne Method #2 This error message suggests that your code is expecting a value of type 'A' to be returned, but instead, the code is returning an object. This error can occur in PhpStorm, or any other PHP development environment. To resolve this error, you should check the function or method that is returning the object and ensure that it is returning
Read more

Laravel file upload returns forbidden 403, file permission is 700 not 755

✔ Recommended Answer The issue you are facing could be due to incorrect file permissions for the storage folder. Here are some steps to fix the problem: SSH into your cPanel server. Change the permission of the storage folder to 755: chmod -R 755 storage/ This command will change the permission of the storage folder and all its contents to 755, which should give the web server permission to read and write to the folder. Check the ownership of the storage folder. Ensure that the owner of the folder is the same as the user running the web server (typically www-data on Apache): ls -l This command will list the files and folders in the current directory along with their ownership and permission details. Make sure that the owner of the storage folder is the same as the user running the web server. If the ownership is incorrect, you can change it using the following command: chown -R www-data:www-data storage/ This command will change the ownership of the storage folder and all its conten
Read more