Tutorial to export data from Azure Blob storage with Azure Import/Export (2024)

  • Article

This article provides step-by-step instructions on how to use the Azure Import/Export service to securely export large amounts of data from Azure Blob storage. The service requires you to ship empty drives to the Azure datacenter. The service exports data from your storage account to the drives and then ships the drives back.

In this tutorial, you learn how to:

  • Prerequisites to export data from Azure Blob storage with Azure Import/Export
  • Step 1: Create an export job
  • Step 2: Ship the drives
  • Step 3: Update the job with tracking information
  • Step 4: Receive the disks
  • Step 5: Unlock the disks

Prerequisites

Before you create an export job to transfer data out of Azure Blob Storage, carefully review and complete the following list of prerequisites for this service.You must:

  • Have an active Azure subscription that can be used for the Import/Export service.

  • Have at least one Azure Storage account. See the list of Supported storage accounts and storage types for Import/Export service. For information on creating a new storage account, see How to Create a Storage Account.

  • Have adequate number of disks of Supported types. You can use the Azure Import/Export tool to determine how many disks to provide. For steps, see Determine drives to use.

  • Have a valid carrier account and a tracking number for the order:

    • You must use a carrier in the Carrier names list on the Shipping tab for your order. If you don't have a carrier account, contact the carrier to create one.
    • The carrier account must be valid, should have a balance, and must have return shipping capabilities. Microsoft uses the selected carrier to return all storage media.
    • Generate a tracking number for the import/export job in the carrier account. Every job should have a separate tracking number. Multiple jobs with the same tracking number aren't supported.

Step 1: Create an export job

  • Portal
  • Azure CLI
  • Azure PowerShell

Perform the following steps to order an import job in Azure Import/Export. The Azure Import/Export service creates a job of the type "Data Box."

  1. Use your Microsoft Azure credentials to sign in at this URL: https://portal.azure.com.

  2. Select + Create a resource and search for Azure Data Box. Select Azure Data Box.

    Tutorial to export data from Azure Blob storage with Azure Import/Export (1)

  3. Select Create.

    Tutorial to export data from Azure Blob storage with Azure Import/Export (2)

  4. To get started with the import order, select the following options:

    1. Select the Export from Azure transfer type.
    2. Select the subscription to use for the Import/Export job.
    3. Select a resource group.
    4. Select the Source Azure region for the job.
    5. Select the Destination country/region for the job.
    6. Then select Apply.

  5. Choose the Select button for Import/Export Job.

    Tutorial to export data from Azure Blob storage with Azure Import/Export (4)

  6. In Basics:

    • Enter a descriptive name for the job. Use the name to track the progress of your job.
      • The name must have from 3 to 24 characters.
      • The name must include only letters, numbers, and hyphens.
      • The name must start and end with a letter or number.

    Tutorial to export data from Azure Blob storage with Azure Import/Export (5)

    Select Next: Job details > to proceed.

  7. In Job Details:

    1. Select the Source Azure region where your data currently is.

    2. Select the storage account from which you want to export data. Use a storage account close to your location.

      The drop-off location is automatically populated based on the region of the storage account that you select.

    3. Specify the blob data to export from your storage account to your blank drive or drives. For Blobs to export, choose one of the three following methods.

      • Choose to export All objects in the storage account.

        Tutorial to export data from Azure Blob storage with Azure Import/Export (6)

      • Choose Selected containers and blobs, and specify containers and blobs to export. You can use more than one of the selection methods. Selecting an Add option opens a panel on the right where you can add your selection strings.

        OptionDescription
        Add containersExport all blobs in a container.
        Select Add containers, and enter each container name.
        Add blobsSpecify individual blobs to export.
        Select Add blobs. Then specify the relative path to the blob, beginning with the container name. Use $root to specify the root container.
        You must provide the blob paths in valid format, as shown in this screenshot, to avoid errors during processing. For more information, see Examples of valid blob paths.
        Add prefixesUse a prefix to select a set of similarly named containers or similarly named blobs in a container. The prefix may be the prefix of the container name, the complete container name, or a complete container name followed by the prefix of the blob name.

        Tutorial to export data from Azure Blob storage with Azure Import/Export (7)

    • Choose Export from blob list file (XML format), and select an XML file that contains a list of paths and prefixes for the blobs to be exported from the storage account. You must construct the XML file and store it in a container for the storage account. The file can't be empty.

      Important

      If you use an XML file to select the blobs to export, make sure that the XML contains valid paths and/or prefixes. If the file is invalid or no data matches the paths specified, the order terminates with partial data or no data exported.

      To see how to add an XML file to a container, go to Export order using XML file.

      Tutorial to export data from Azure Blob storage with Azure Import/Export (8)

    Note

    If a blob to be exported is in use during data copy, the Azure Import/Export service takes a snapshot of the blob and copies the snapshot.

    Select Next: Return shipping > to proceed.

  8. In Return shipping:

    1. Select a shipping carrier from the drop-down list for Carrier. The location of the Microsoft datacenter for the selected region determines which carriers are available.

    2. Enter a Carrier account number. The account number for a valid carrier account is required.

    3. In the Return address area, use + Add Address to add the address to ship to.

      Tutorial to export data from Azure Blob storage with Azure Import/Export (9)

      On the Add Address blade, you can add an address or use an existing one. When you finish entering address information, select Add shipping address.

      Tutorial to export data from Azure Blob storage with Azure Import/Export (10)

    4. In the Notification area, enter email addresses for the people you want to notify of the job's progress.

      Tip

      Instead of specifying an email address for a single user, provide a group email to ensure that you receive notifications even if an admin leaves.

    Tutorial to export data from Azure Blob storage with Azure Import/Export (11)

    Select Review + Create to proceed.

  9. In Review + Create:

    1. Review the Terms, and then select "I acknowledge that all the information provided is correct and agree to the terms and conditions above." Validation is then performed.
    2. Review the job information. Make a note of the job name and the Azure datacenter shipping address to ship disks back to. This information is used later on the shipping label.
    3. Select Create.

    Tutorial to export data from Azure Blob storage with Azure Import/Export (12)

  10. After the job is created, you'll see the following message.

    Tutorial to export data from Azure Blob storage with Azure Import/Export (13)

    You can select Go to resource to open the Overview of the job.

Step 2: Ship the drives

If you don't know the number of drives you need, see Determine how many drives you need. If you know the number of drives, proceed to ship the drives.

FedEx, UPS, or DHL can be used to ship the package to Azure datacenter. If you want to use a carrier other than FedEx/DHL, contact Azure Data Box Operations team at adbops@microsoft.com

  • Provide a valid FedEx, UPS, or DHL carrier account number for use by Microsoft to return the drives.
    • A FedEx, UPS, or DHL account number is required for shipping drives back from the US and Europe locations.
      • A DHL account number is preferred for shipping drives back from Asia and Australia locations.
      • If you don't have an account number, create a FedEx or DHL carrier account.
  • When shipping your packages, you must follow the Microsoft Azure Service Terms.
  • Properly package your disks to avoid potential damage and delays in processing. Follow these recommended best practices:
    • Wrap the disk drives securely with protective bubble wrap. Bubble wrap acts as a shock absorber and protects the drive from impact during transit. Before shipping, ensure that the entire drive is thoroughly covered and cushioned.
    • Place the wrapped drives within a foam shipper. The foam shipper provides extra protection and keeps the drive securely in place during transit.

Step 3: Update the job with tracking information

After you ship the disks, return to the job in the Azure portal and fill in the tracking information.

After you provide tracking details, the job status changes to Shipping, and the job can't be canceled. You can only cancel a job while it's in Creating state.

Important

If the tracking number is not updated within 2 weeks of creating the job, the job expires.

  • Portal
  • Azure CLI
  • Azure PowerShell

To complete the tracking information for a job that you created in the portal, do these steps:

  1. Open the job in the Azure portal/.

  2. On the Overview pane, scroll down to Tracking information and complete the entries:

    1. Provide the Carrier and Tracking number.
    2. Make sure the Ship to address is correct.
    3. Select the checkbox by "Drives have been shipped to the above mentioned address."
    4. When you finish, select Update.

You can track the job progress on the Overview pane. For a description of each job state, go to View your job status.

Tutorial to export data from Azure Blob storage with Azure Import/Export (16)

Step 4: Receive the disks

When the dashboard reports the job is complete, the disks are shipped to you and the tracking number for the shipment is available in the portal.

  1. After you receive the drives with exported data, you need to get the BitLocker keys to unlock the drives. Go to the export job in the Azure portal. Select Import/Export tab.

  2. Select your export job from the list. Go to Encryption and copy the keys.

    Tutorial to export data from Azure Blob storage with Azure Import/Export (17)

  3. Use the BitLocker keys to unlock the disks.

The export is complete.

Step 5: Unlock the disks

Use the following command to unlock the drive:

WAImportExport Unlock /bk:<BitLocker key (base 64 string) copied from Encryption blade in Azure portal> /driveLetter:<Drive letter>

Here's an example of the sample input.

WAImportExport.exe Unlock /bk:CAAcwBoAG8AdQBsAGQAIABiAGUAIABoAGkAZABkAGUAbgA= /driveLetter:e

You can use the copy logs from the job to verify that all data transferred successfully:

  • Use the verbose log to verify each successfully transferred file.
  • Use the copy log to find the source of each failed data copy.

To find the log locations, open the job in the Azure portal/. The Data copy details show the Copy log path and Verbose log path for each drive that was included in the order.

At this time, you can delete the job or leave it. Jobs automatically get deleted after 90 days.

Next steps

  • View the job and drive status
  • Review Import/Export copy logs
Tutorial to export data from Azure Blob storage with Azure Import/Export (2024)

FAQs

How to export data from Azure blob storage? ›

Usage
  1. Create the Destination Container in Microsoft Azure Blob Storage. ...
  2. Write the Query. ...
  3. Specify the Result Export target. ...
  4. Configure Export Results in Your Data Connection.
  5. Execute the query. ...
  6. account_name/account_key case. ...
  7. Optional Configure Export Results in Workflow.
Jul 17, 2024

How do I import data from Azure Blob storage? ›

You can use the IMPORT and EXPORT commands to load data from Azure Blob Storage. By default, the IMPORT and EXPORT commands download or upload data blocks of 10 MB in parallel using two threads. The maximum file size that you can import is approximately 500GB.

How to fetch data from Azure blob storage? ›

Source
  1. On the lower ribbon of your KQL database, select Get Data. In the Get data window, the Source tab is selected.
  2. Select the data source from the available list. In this example, you're ingesting data from Azure storage.
May 21, 2024

What is the fastest way to download from Azure Blob storage? ›

You can try using the AzCopy tool to download blobs from Azure Blob Storage. AzCopy is a command-line utility that you can use to copy data to and from Azure Blob Storage. It is designed to be fast and efficient, and it can transfer data at speeds of up to 10 Gbps.

How do I extract data from Blob? ›

Extracting data from a blob

const text = await blob.text(); By using other methods of FileReader , it is possible to read the contents of a Blob as a string or a data URL.

How do I download all files from Azure Blob Storage? ›

Downloading Files from Azure Container App to your Local Machine via Azure Blob Storage
  1. Step 1: Accessing the Azure Container App Console. ...
  2. Step 2: Installing `curl` ...
  3. Step 3: Creating the `curl` Command. ...
  4. Step 4: Executing the curl Command. ...
  5. Step 5: Downloading the file from Azure Storage to your Local Machine.
Mar 22, 2023

How do I ingest data from Azure Blob Storage? ›

Prepare database and blob storage

Selecting "Container (anonymous read access for containers and blobs)" will allow you to ingest files from Azure Blob Storage using their public URLs and enumerating the container contents without the need to configure an account key in pg_azure_storage.

How to retrieve files from Azure Blob Storage? ›

On the Initiate Restore tab, choose Azure Blobs (Azure Storage) as the Datasource type and select the Backup Instance you want to restore. The backup instance is the storage account that contains the blobs you want to restore. On the Select recovery point tab, select the type of backup you want to restore.

Can I query from Blob Storage? ›

Because your blob content is indexed into a search index, you can use the full range of query features in Azure AI Search to find information in your blob content.

What is the difference between Azure files and Blob Storage? ›

Azure Blob Storage and Azure File Storage (officially called Azure Files) are both Azure services designed for storing data in the cloud, but they serve different purposes. Blob storage is optimal for handling unstructured data, while file storage excels in managing structured data with shared access.

How do I move files from Azure Blob Storage? ›

Additional resources
  1. Use AzCopy to copy blobs between storage accounts with access restriction - Azure.
  2. Use AzCopy to copy data from Amazon S3 to Azure Storage. AzCopy is a command-line utility that you can use to copy blobs or files to or from a storage account.
  3. Copy blobs between Azure storage accounts with AzCopy v10.
Mar 6, 2024

How to download file from Azure Blob Storage using Azure CLI? ›

File transfer from blob storage using azure cli
  1. List blob. az storage blob list -c <container-name>
  2. Upload. az storage blob upload -f file.txt -c <container-name> -n file.txt.
  3. Download. az storage blob download -f file.txt -c <container-name> -n file.txt.
Jun 2, 2021

How do I copy data from Azure Blob Storage to Azure SQL database? ›

You take the following steps in this tutorial:
  1. Create a data factory.
  2. Create Azure Storage and Azure SQL Database linked services.
  3. Create Azure Blob and Azure SQL Database datasets.
  4. Create a pipeline contains a Copy activity.
  5. Start a pipeline run.
  6. Monitor the pipeline and activity runs.
May 15, 2024

How to export blob data from SQL? ›

  1. from your database in 4 easy steps. using SQL Blob Export.
  2. STEP 1: Create a new export project. This allows you to. ...
  3. STEP 2: Enter the connection properties for the database. ...
  4. STEP 3: Select the table you want to extract the items from. ...
  5. STEP 4: Enter the folder name to store the exported items.

How to export Azure storage table data? ›

To copy data from Azure Table, set the source type in the copy activity to AzureTableSource. The following properties are supported in the copy activity source section. The type property of the copy activity source must be set to AzureTableSource. Use the custom Table storage query to read data.

Top Articles
Update or cancel your Home Insurance policy
Active Index Fund: Meaning, Limitations, Example
Katie Pavlich Bikini Photos
Gamevault Agent
Hocus Pocus Showtimes Near Harkins Theatres Yuma Palms 14
Free Atm For Emerald Card Near Me
Craigslist Mexico Cancun
Hendersonville (Tennessee) – Travel guide at Wikivoyage
Doby's Funeral Home Obituaries
Vardis Olive Garden (Georgioupolis, Kreta) ✈️ inkl. Flug buchen
Select Truck Greensboro
Things To Do In Atlanta Tomorrow Night
Non Sequitur
How To Cut Eelgrass Grounded
Pac Man Deviantart
Alexander Funeral Home Gallatin Obituaries
Craigslist In Flagstaff
Shasta County Most Wanted 2022
Energy Healing Conference Utah
Testberichte zu E-Bikes & Fahrrädern von PROPHETE.
Aaa Saugus Ma Appointment
Geometry Review Quiz 5 Answer Key
Walgreens Alma School And Dynamite
Bible Gateway passage: Revelation 3 - New Living Translation
Yisd Home Access Center
Home
Shadbase Get Out Of Jail
Gina Wilson Angle Addition Postulate
Celina Powell Lil Meech Video: A Controversial Encounter Shakes Social Media - Video Reddit Trend
Walmart Pharmacy Near Me Open
A Christmas Horse - Alison Senxation
Ou Football Brainiacs
Access a Shared Resource | Computing for Arts + Sciences
Pixel Combat Unblocked
Cvs Sport Physicals
Mercedes W204 Belt Diagram
Rogold Extension
'Conan Exiles' 3.0 Guide: How To Unlock Spells And Sorcery
Teenbeautyfitness
Where Can I Cash A Huntington National Bank Check
Facebook Marketplace Marrero La
Nobodyhome.tv Reddit
Topos De Bolos Engraçados
Gregory (Five Nights at Freddy's)
Grand Valley State University Library Hours
Holzer Athena Portal
Hampton In And Suites Near Me
Stoughton Commuter Rail Schedule
Bedbathandbeyond Flemington Nj
Free Carnival-themed Google Slides & PowerPoint templates
Otter Bustr
Selly Medaline
Latest Posts
Article information

Author: Kelle Weber

Last Updated:

Views: 5553

Rating: 4.2 / 5 (53 voted)

Reviews: 92% of readers found this page helpful

Author information

Name: Kelle Weber

Birthday: 2000-08-05

Address: 6796 Juan Square, Markfort, MN 58988

Phone: +8215934114615

Job: Hospitality Director

Hobby: tabletop games, Foreign language learning, Leather crafting, Horseback riding, Swimming, Knapping, Handball

Introduction: My name is Kelle Weber, I am a magnificent, enchanting, fair, joyous, light, determined, joyous person who loves writing and wants to share my knowledge and understanding with you.