Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escape special characters +-&|!(){}[]^"~*?:\ - e.g. \+ \* \!
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
 
Answered
Good security practices for transmitting some account balances into S3 bucket using SFTP or AWS SDK?

Hello!

We're looking into creating an Ardent extension that will perform a batch processing job nightly (at-demand) for a client. The extension will need to process some accounts' basic info on account and balances into files and upload into client's S3 bucket.

  1. What are the importants steps to ensure the files are securely uploaded to the SFTP? Security regulations? Do we need to encrypt the files before uploading into S3 and provide them the public key to decrypt it?

  2. Can we use AWS SDK within Ardent extension (https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3-examples.html?)

Posted 4 years ago
Votes Newest

Answers


You can use the boto3 python package within the SDK, including Ardent extensions. It's not async by default so you will want to wrap it in an asyncio subprocess.

The security practices are up to you. We have extensions moving files via sftp to outside file servers. You will need to request a whitelist via the Developer Portal in order to contact hosts outside of the datacenter. Part of the whitelist request is a description of what customer information will be transmitted and what protocols you're using.

Note that we do have built in ways of delivering files via S3:

https://docs.q2developer.com/docs/guides/online_integration/file_uploads.html

This would place the file in a temporary S3 location owned by Q2.

Posted 4 years ago
Mark Ostroth
309 × 5 Administrator
116 Views
1 Answer
4 years ago
4 years ago
Tags