Data migration specialist Datadobi adds S3-to-S3 support

Data migration expert Datadobi is bolstering its DobiMigrate application with support for Dell EMC’s PowerStore midrange lineup and numerous item retailers that are appropriate with Amazon’s S3 API.

Prospects can use Datadobi application to go facts from non-Dell EMC storage arrays to the new PowerStore programs that released in Could. The extension of support to the most recent Dell EMC storage arrives as no shock. Four former EMC engineers founded Datadobi in 2010, and the Belgium-dependent enterprise has worked closely with EMC, and subsequently, Dell EMC, on facts migration from Centera and NAS programs.

The support for S3-to-S3 item facts migration with the DobiMigrate 5.nine update, due on July thirteen, is much more of a novel twist for Datadobi. The DobiMigrate application could allow shoppers to shift facts from Amazon’s Very simple Storage Company (S3) to on-premises S3-dependent item retailers, and vice versa. Datadobi strategies to support AWS S3, Cloudian HyperStore, Dell EMC ECS, IBM Cloud Item Storage, NetApp StorageGrid and Scality Zenko CloudServer when DobiMigrate 5.nine launches.

Datadobi CTO Carl D’Halluin reported the enterprise would examination and guarantee compatibility with other S3-dependent item retailers dependent on buyer requests. Achievable alternatives include item retailers from Google, Backblaze and Wasabi to support shoppers migrate facts between community clouds.

Datadobi DobiMigrate.
Datadobi’s DobiMigrate 5.nine update provides the capacity to go facts between item retailers that support Amazon’s S3 API.

Data migration from AWS

But Michael Jack, Datadobi’s co-founder and VP of world wide gross sales, expects the most well known use case could be AWS to on-premises item storage to support shoppers avoid the egress expenses that Amazon and other cloud companies charge to obtain facts. A secondary supply of demand from customers could be shoppers refreshing their item storage for greater performance or better overall performance.

“There was a massive flurry of media a 12 months and a fifty percent in the past all over repatriation — that repatriation is going to be massive mainly because Amazon’s way too highly-priced,” Jack reported. But, fairly than a “huge tsunami of alternatives,” Jack expects to see “incremental enterprise” from shoppers that really don’t want to be locked in to a certain storage seller or storage.

A large amount of folks get upset about the egress expenses that they failed to truly fully grasp with community cloud storage.
Marc StaimerPresident, Dragon Slayer Consulting

“A large amount of folks get upset about the egress expenses that they failed to truly fully grasp with community cloud storage,” reported Marc Staimer, president of Dragon Slayer Consulting. “They want to go, but there’s no straightforward way to migrate from S3 to S3 natively, so they need to have a third celebration.”

Datadobi specializes in migrating massive quantities of facts. The enterprise originally concentrated on going facts out of EMC’s Centera material-addressable storage and then constructed DobiMigrate to tackle NAS migration when EMC’s Isilon workforce achieved out. The DobiMigrate 5.nine update will add connectors to S3 on best of the NAS migration framework, incorporating critical lessons that Datadobi’s engineering workforce uncovered as a result of its NAS get the job done about the incompatibilities and vagaries in diverse vendors’ programs.

S3 facts migration is not trivial

“We believed S3 would be very simple, mainly because it is really a very simple protocol, but the exact is accurate here,” D’Halluin reported. “Copying around S3 facts is not trivial, and enterprises want some guarantees that the facts is copied around thoroughly.”

D’Halluin reported Datadobi engineers experienced to “invent new ways” to scan the S3 material and allow fast copying and parallel scanning. DobiMigrate runs on premises driving the facts center’s firewall, under the regulate of the facts centre administrator. The application can synchronize the objects and metadata from the supply buckets to the concentrate on buckets.

“Just one of the product’s values to the business is the scale at which it can function,” reported Krista Macomber, a senior analyst at Evaluator Team. “This is critical for enterprises seeking to migrate petabytes of facts. The scanning approach is multithreaded, and original entire, as well as incremental, scans manifest exterior of the facts path. This assists to speed up the scanning and copying approach and reduce down on the upkeep window.”

Macomber thinks much more Datadobi shoppers could go S3 facts to the cloud, for disaster recovery or archival purposes or as element of a legacy application migration. But she reported pulling facts back again on premises could also be critical as enterprise analytics will become much more well known.

DobiMigrate supports only NAS-to-NAS or S3-to-S3 migrations. The application does not supply gateway solutions to migrate file-dependent NAS facts to S3-dependent item retailers, or vice versa. Datadobi supports the migration of facts from NAS or Centera programs to S3 item retailers only on an unique job basis.

Datadobi roadmap

Datadobi roadmap items include optimizing migrations from Amazon’s Glacier, cold storage as well as support for superior item capabilities such as locking and tagging. D’Halluin reported there is no incentive however to support migrations between S3-dependent item retailers and Microsoft’s Azure mainly because merchandise support for Azure’s Blob item storage API is nominal.

D’Halluin reported Datadobi strategies to section in S3-to-S3 migration abilities and support shoppers evaluate which facts to bring back again from AWS, retain in the cloud or delete entirely. He expects shoppers originally will need to have support, so Datadobi will supply the new S3-to-S3 performance as a provider before building it offered as a result of the do-it-yourself application.

DobiMigrate has a 50 TB minimum amount for S3-to-S3 migrations. Jack approximated the provider list price tag would start at about $forty five,000 for a 50 TB migration, relying on the customer’s choice of storage seller, programs integrator or a worth-additional reseller to supply it. Jack reported the do-it-yourself application would list at about $30,000 for an S3-to-S3 migration of 50 TB of facts.

Jack approximated that 25% of Datadobi’s shoppers use the application on their have, and 75% go as a result of the firm’s much more than 100 companions. Datadobi sells only as a result of the channel, but Jack reported the firm’s gross sales firm communicates immediately with all shoppers. In addition to DobiMigrate, Datadobi sells DobiReplicate for NAS-to-NAS file-dependent replication and DobiSync for file-to-item synchronization.

Datadobi claims to have much more than 800 shoppers, including provider companies and enterprises in industries such as fiscal solutions, health care, oil and fuel, and media and entertainment. They tend to have massive amounts of facts that can scale previous 1 PB in intricate multivendor environments spanning on-premises and cloud internet sites, according to Jack.

Datadobi’s competition consists of cost-free resources such as robocopy and rsync, as well as Data Dynamics and Komprise. Jack reported Datadobi focuses on massive one particular-time, “fire-hose” types of migrations in comparison to the “trickle” technique that Data Dynamics and Komprise consider with their facts administration/migration items.

Staimer reported StrongBox Data Remedies offers S3-to-S3 migration as a characteristic but finds that the quantities of moved item-dependent facts tend to be compact in comparison to the multi-petabyte jobs the seller does with file-dependent facts.