Replies: 2
Hello,
We created snapshots and exported them to S3 using the Snapshot Export tool. We are trying to figure out how to import them into HBase so that they are a) visible as snapshots and b) can be cloned into a viable table.
To export (as hbase user):
hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot '$snapshotname' -copy-to s3n://$bucket_name/$snapshotname -mappers 4
,
with AWS credentials already configured in HDFS.
We’re having trouble importing them to another cluster. There is no “Snapshot Import” tool. We’ve been attempting to use hadoop distcp to copy from S3 to the target HDFS:
hadoop distcp s3n://s3n://$bucket_name/$snapshotname /apps/hbase/data/.hbase-snapshot
But the import includes a different file structure than we see when we export a snapshot between clusters. Snapshots either a) don’t appear or b) are corrupted and cannot be cloned.
Please help indicate the correct import path when copying an exported Snapshot from a DFS source.
Relevant information:
HDP: 2.1
HBase: 0.98.0.2.1