Installation

Amazon Web Services

REQUIREMENTS

To use CloudDat, you will need the following:

  • An Amazon Web Services account
  • An S3 bucket
  • EC2 SSH Keys for the bucket's region
  • A high-speed Internet path to Amazon Web Services
  • A Secure Shell (SSH) client

DISTRIBUTION METHODS

CloudDat for AWS may be obtained through AWS marketplace as a subscription, or directly from DEI as a perpetual, term, or trial license.

For AWS Marketplace, follow either the CloudFormation or Single AMI instructions.  If you are not proficient with AWS EC2 or Linux, CloudFormation is recommended.  For licenses obtained directly from DEI, follow the Stand Alone instructions.  For use with on non-AWS, S3 compatible environments, see S3 Compatible.

CloudFormation Single AMI Stand Alone S3 Compatible

The AWS Marketplace "Single AMI" delivery method launches the instance without any setup.  You must manually create and attach an IAM Role and security group prior to launch, then use Secure Shell to complete instance setup.  This process requires familiarity with Linux and EC2 setup.

  1. Verify that you have all of the requirements listed above.
  2. Choose an S3 account and bucket to access.
    Note which region hosts the bucket.  Buckets in the "Standard" region are "US East (N. Virginia)".
  3. Create an IAM Role
    Use the AWS "Identity & Access Management" console to create or choose an IAM role.  Attach a policy which allows the following S3 access rights to the S3 bucket(s) you will use with the gateway.  This step is done automatically if you choose the Cloud Formation method.
    "s3:AbortMultipartUpload", "s3:DeleteObject", "s3:GetBucketLocation", "s3:GetObject", "s3:ListBucket", "s3:ListBucketMultipartUploads", "s3:ListMultipartUploadParts", "s3:PutObject", "aws-marketplace:RegisterUsage"
  4. Create a Security Group
    Use the AWS EC2 "Security Groups" page to create a group with the following ports open: TCP/80 (HTTP), TCP/22 (SSH), and UDP/8080 (ExpeDat). Security Group
  5. Go to the AWS Marketplace page and choose the Hourly, Monthly, or Monthly High Capacity CloudDat product.  Choose the Hourly product for the 7-day free trial.
  6. Click the "Continue to Subscribe" button at the top of the page, even if you are already subscribed. Continue Button
  7. If this is your first time subscribing to this product, or if you have previously cancelled your subscription, click the "Accept Software Terms" button.  If you are already subscribed, you will skip to the next step. Accept Button
  8. The next screen will verify that you are subscribed and may display other offers, terms, and details.  Click "Continue to Configuration". Continue to Configuration
  9. Select a "Delivery Method" by clicking on the dropdown menu and choosing "Amazon Machine Image".  If drop-down menus interfere with your ability to make a selection, try making your browser window wider.  Some regions may not display the Single AMI option from the product page.  If Single AMI is not shown, launch through the Marketplace Console page instead. Delivery Method AMI
  10. Verify that the latest "Software version" is selected.  Older versions, if available, may not be fully supported.
  11. In the "Region" box, select the AWS region where your S3 bucket is located.  Selecting a different region may cause the launch process to fail, or result in very poor performance. Region
  12. Click "Continue to Launch" at the top of the page. Continue to Launch
  13. In the "Choose Action" box, select "Launch through EC2". Launch AMI
  14. Click the "Launch" button.  This does not actually launch the software, it just starts the configuration process. Launch
  15. You should now be directed to the EC2 "Launch an instance" page.  AWS has recently changed this to a "New experience", with more limited functionality.  These instructions follow the "New experience" as of the August 2022.  Begin by selecting a name for your CloudDat instance. Name
  16. Scroll down to select the "Instance type", based on your desired performancec5n and c6in types give the best performance, but some AWS regions do not support them.  You may use c5 or c6i where necessary. Instance Type
  17. Next, select the SSH key pair to use with your instance.  You may also be given an option to create a new one. Instance Type
  18. Under "Network settings", select the existing security group that you created at the start or one that you have used with other CloudDat instances. Security Group
  19. Open the "Advanced details" section and locate the "IAM instance profile" section.  Select the IAM Role you created at the start or one that you have used with other CloudDat instances.  You may also be given an option to create a new one. IAM Role
  20. Scroll down to the "Summary" section and review the configuration.  When you are ready, click "Launch instance" (this time it really will launch the instance). Launch instance
  21. Return to the Instance list and wait for the Instance to report Ready.
  22. Zoom for Screenshot

    Once the instance is ready, ssh to the ec2-user account on that instance.  When the instance is first being launched, the setup script will run automatically.  Later, you can run it manually by executing /usr/local/expedat/s3setup.sh.  Click the screenshot on the right to see an example.
  23. The script will identify the IAM Role attached to the gateway.  If the role cannot be found or is incorrect, AWS requires that you terminate the instance and start over.
  24. Next, the script will ask for the name of the S3 bucket you wish to access.  Do not enter the endpoint URL, just the name.  The script will test whether the bucket exists, is accessible, and is in the same region as the gateway.  If a problem is found, follow the instructions or contact us for help.
  25. Finally, the script will ask you to enter a username and password for your initial gateway account.  These are the credentials end-users will enter into ExpeDat clients to access your S3 bucket.  You may create additional accounts later.
  26. Zoom for Screenshot

    Upon successfully completing the setup script, the URL of the gateway will be shown.  Direct a web browser to that instance public address.  An example page is shown on the right.
  27. Download a client.
    Choose Windows or Mac for the graphical client and extract the contents of the ZIP package after download.  A command line client is included in the "Full Client Package" links near the bottom of the page.
  28. Zoom for Screenshot

    Run the client.
    No installation is required.  You may move the client executable to any location on your system before running it.
  29. Back in the web browser, click "Access your S3 Bucket".
    Your browser may ask you to confirm launching ExpeDat Desktop.  The ExpeDat Desktop client will prompt you to enter the password you created earlier.  For command line clients, see the Client Use page.

After clicking the Access link, the client will list the contents of your S3 bucket (if any) and you can begin transferring files.  You may wish to bookmark the link for easy access later.  The next page describes more about using clients.  See the Support page if you the client has trouble reaching the CloudDat instance.

Next: Client Use >

Free Trial

Try before you buy

We're so confident in our technology that all of our end-user products are available to try - no strings attached.

Request Trial