Data Expedition, Inc.
News
Articles, events, announcements, and blogs
Data Expedition, Inc.
News
Articles, events, announcements, and blogs
When we first launched CloudDat into AWS Marketplace back in 2013, the maximum throughput S3 could support was around 700 megabits per second. We were told by AWS engineers that this was a fundamental limitation of their architectures. Not quite ten years later, we just launched a new version of CloudDat capable of uploading to S3 at 5 gigabits per second per instance, the maximum rate AWS now allows for EC2 internet data transfer.
Speed gains like that are to be expected in the industry that practically invented hyperscaling. But faster capabilities don't automatically translate into faster workflows. Uploading to S3 storage using typical browser tools is still slow, around a hundred megabits per second with a lot of variation. Meanwhile, data sets keep getting larger, automated workflows demand well-fed S3 buckets, and the value from any cloud deployment quickly drains away when time is wasted waiting for resources to load.
Keeping data transfer top-of-mind is essential to planning cloud workflows. Nothing can get started in the cloud until the data gets there. That not only means feeding data hungry processes like video transcoding or machine learning, it also means starting business critical timers like hourly rates and project SLAs. It is vital to plan how data will move throughout the project life-cycle, starting with where it will come from.
Most cloud services assume that the data they need is already in an S3 bucket. But when customers ask how they should get the data there, vendors often lack clear answers. Without accelerated tools like CloudDat, transferring data over the internet can be so slow as to be a non-starter for many projects, especially when high quality media is involved. But shipping hard-drives can be even worse, with manpower intensive and error-prone setup followed by weeks of lag time.
CloudDat removes the complexity and cost from this critical first step by allowing terabytes of data per hour to be transferred across commodity internet connections directly to S3 from anywhere in the world with just a few minutes of setup. With it's 7-day free trial in AWS Marketplace, and low hourly cost after that, it is possible to test assumptions about data transfer capabilities early in the planning process, before even proof-of-concept stage.
We are always available to answer questions and provide guidance, and our channel partners can help you with integration and deployment. Just ask.