Tutorial - Create and manage exported data from Cost Management - Microsoft Cost Management (2023)

  • Article
  • 16 minutes to read

If you read the Cost Analysis tutorial, then you're familiar with manually downloading your Cost Management data. However, you can create a recurring task that automatically exports your Cost Management data to Azure storage on a daily, weekly, or monthly basis. Exported data is in CSV format and it contains all the information that's collected by Cost Management. You can then use the exported data in Azure storage with external systems and combine it with your own custom data. And you can use your exported data in an external system like a dashboard or other financial system.

Watch the How to schedule exports to storage with Cost Management video about creating a scheduled export of your Azure cost data to Azure Storage. To watch other videos, visit the Cost Management YouTube channel.

The examples in this tutorial walk you through exporting your cost management data and then verify that the data was successfully exported.

In this tutorial, you learn how to:

  • Create a daily export
  • Verify that data is collected

Prerequisites

Data export is available for various Azure account types, including Enterprise Agreement (EA) and Microsoft Customer Agreement customers. To view the full list of supported account types, see Understand Cost Management data. The following Azure permissions, or scopes, are supported per subscription for data export by user and group. For more information about scopes, see Understand and work with scopes.

  • Owner - Can create, modify, or delete scheduled exports for a subscription.
  • Contributor - Can create, modify, or delete their own scheduled exports. Can modify the name of scheduled exports created by others.
  • Reader - Can schedule exports that they have permission to.
    • For more information about scopes, including access needed to configure exports for Enterprise Agreement and Microsoft Customer agreement scopes, see Understand and work with scopes.

For Azure Storage accounts:

(Video) Azure Cost Management - Exports

  • Write permissions are required to change the configured storage account, independent of permissions on the export.
  • Your Azure storage account must be configured for blob or file storage.
  • The storage account must not have a firewall configured.
  • The storage account configuration must have the Permitted scope for copy operations (preview) option set to From any storage account.

If you have a new subscription, you can't immediately use Cost Management features. It might take up to 48 hours before you can use all Cost Management features.

Sign in to Azure

Sign in to the Azure portal at https://portal.azure.com.

Create a daily export

  • Portal
  • Azure CLI
  • Azure PowerShell

To create or view a data export or to schedule an export, choose a scope in the Azure portal and select Cost analysis in the menu. For example, navigate to Subscriptions, select a subscription from the list, and then select Cost analysis in the menu. At the top of the Cost analysis page, select Settings, then Exports.

Note

  • Besides subscriptions, you can create exports on resource groups, management groups, departments, and enrollments. For more information about scopes, see Understand and work with scopes.
  • When you're signed in as a partner at the billing account scope or on a customer's tenant, you can export data to an Azure Storage account that's linked to your partner storage account. However, you must have an active subscription in your CSP tenant.
  1. Select Add and type a name for the export.
  2. For the Metric, make a selection:
    • Actual cost (Usage and Purchases) - Select to export standard usage and purchases
    • Amortized cost (Usage and Purchases) - Select to export amortized costs for purchases like Azure reservations and Azure savings plan for compute.
  3. For Export type, make a selection:
    • Daily export of month-to-date costs - Provides a new export file daily for your month-to-date costs. The latest data is aggregated from previous daily exports.
    • Weekly export of cost for the last seven days - Creates a weekly export of your costs for the past seven days from the selected start date of your export.
    • Monthly export of last month's costs - Provides you with an export of your last month's costs compared to the current month that you create the export. Afterward, the schedule runs an export on the fifth day of every new month with your previous months costs.
    • One-time export - Allows you to choose a date range for historical data to export to Azure blob storage. You can export a maximum of 90 days of historical costs from the day you choose. This export runs immediately and is available in your storage account within two hours.Depending on your export type, either choose a start date, or choose a From and To date.
  4. Specify the subscription for your Azure storage account, then select a resource group or create a new one.
  5. Select the storage account name or create a new one.
  6. Select the location (Azure region).
  7. Specify the storage container and the directory path that you'd like the export file to go to.
  8. Review your export details and select Create.

Your new export appears in the list of exports. By default, new exports are enabled. If you want to disable or delete a scheduled export, select any item in the list, and then select either Disable or Delete.

Initially, it can take 12-24 hours before the export runs. However, it can take up longer before data is shown in exported files.

Export schedule

Scheduled exports are affected by the time and day of week of when you initially create the export. When you create a scheduled export, the export runs at the same frequency for each export that runs later. For example, for a daily export of month-to-date costs export set at a daily frequency, the export runs during once each UTC day. Similarly for a weekly export, the export runs every week on the same UTC day as it is scheduled. Individual export runs can occur at different times throughout the day. So, avoid taking a firm dependency on the exact time of the export runs. Run timing depends on the active load present in Azure during a given UTC day. When an export run begins, your data should be available within 4 hours.

Exports are scheduled using Coordinated Universal Time (UTC). The Exports API always uses and displays UTC.

(Video) How to schedule exports to storage with Azure Cost Management

  • When you create an export using the Exports API, specify the recurrencePeriod in UTC time. The API doesn’t convert your local time to UTC.
    • Example - A weekly export is scheduled on Friday, August 19 with recurrencePeriod set to 2:00 PM. The API receives the input as 2:00 PM UTC, Friday, August 19. The weekly export will be scheduled to run every Friday.
  • When you create an export in the Azure portal, its start date time is automatically converted to the equivalent UTC time.
    • Example - A weekly export is scheduled on Friday, August 19 with the local time of 2:00 AM IST (UTC+5:30) from the Azure portal. The API receives the input as 8:30 PM, Thursday, August 18. The weekly export will be scheduled to run every Thursday.

Each export creates a new file, so older exports aren't overwritten.

Create an export for multiple subscriptions

If you have an Enterprise Agreement, then you can use a management group to aggregate subscription cost information in a single container. Then you can export cost management data for the management group. When you create an export in the Azure portal, select the Actual Costs option. When you create a management group export using the API, create a usage export. Currently, exports at the management group scope only support usage charges. Purchases including reservations and savings plans aren't present in your exports file.

Exports for management groups of other subscription types aren't supported.

  1. If you haven't already created a management group, create one group and assign subscriptions to it.
  2. In cost analysis, set the scope to your management group and select Select this management group.
  3. Create an export at the scope to get cost management data for the subscriptions in the management group.Tutorial - Create and manage exported data from Cost Management - Microsoft Cost Management (4)

File partitioning for large datasets

If you have a Microsoft Customer Agreement, Microsoft Partner Agreement, or Enterprise Agreement, you can enable Exports to chunk your file into multiple smaller file partitions to help with data ingestion. When you initially configure your export, set the File Partitioning setting to On. The setting is Off by default.

If you don't have a Microsoft Customer Agreement, Microsoft Partner Agreement, or Enterprise Agreement, then you won't see the File Partitioning option.

Partitioning isn't currently supported for resource groups or management group scopes.

Update existing exports to use file partitioning

If you have existing exports and you want to set up file partitioning, create a new export. File partitioning is only available with the latest Exports version. There may be minor changes to some of the fields in the usage files that get created.

If you enable file partitioning on an existing export, you may see minor changes to the fields in file output. Any changes are due to updates that were made to Exports after you initially set yours up.

Partitioning output

When file partitioning is enabled, you get a file for each partition of data in the export along with a _manifest.json file. The manifest contains a summary of the full dataset and information for each file partition in it. Each file partition has headers and contains only a subset of the full dataset. To handle the full dataset, you must ingest each partition of the export.

(Video) Azure Cost Management Tutorial | Analyzing and reacting to changes in billing

Here's a _manifest.json example manifest file.

{ "manifestVersion": "2021-01-01", "dataFormat": "csv", "blobCount": 1, "byteCount": 160769, "dataRowCount": 136, "blobs": [ { "blobName": "blobName.csv", "byteCount": 160769, "dataRowCount": 136, "headerRowCount": 1, "contentMD5": "md5Hash" } ]}

Export versions

When you create a scheduled export in the Azure portal or with the API, it always runs on the exports version used at creation time. Azure keeps your previously created exports on the same version, unless you update it. Doing so prevents changes in the charges and to CSV fields if the export version is changed. As the export functionality changes over time, field names are sometimes changed and new fields are added.

If you want to use the latest data and fields available, we recommend that you create a new export in the Azure portal. To update an existing export to the latest version, update it in the Azure portal or with the latest Export API version. Updating an existing export might cause you to see minor differences in the fields and charges in files that are produced afterward.

Verify that data is collected

You can easily verify that your Cost Management data is being collected and view the exported CSV file using Azure Storage Explorer.

In the export list, select the storage account name. On the storage account page, select Open in Explorer. If you see a confirmation box, select Yes to open the file in Azure Storage Explorer.

Tutorial - Create and manage exported data from Cost Management - Microsoft Cost Management (6)

In Storage Explorer, navigate to the container that you want to open and select the folder corresponding to the current month. A list of CSV files is shown. Select one and then select Open.

Tutorial - Create and manage exported data from Cost Management - Microsoft Cost Management (7)

The file opens with the program or application that's set to open CSV file extensions. Here's an example in Excel.

Tutorial - Create and manage exported data from Cost Management - Microsoft Cost Management (8)

(Video) Azure - Export Data from Cost Management !!!

Download an exported CSV data file

You can also download the exported CSV file in the Azure portal. The following steps explain how to find it from cost analysis.

  1. In cost analysis, select Settings, and then select Exports.
  2. In the list of exports, select the storage account for an export.
  3. In your storage account, select Containers.
  4. In list of containers, select the container.
  5. Navigate through the directories and storage blobs to the date you want.
  6. Select the CSV file and then select Download.

View export run history

You can view the run history of your scheduled export by selecting an individual export in the exports list page. The exports list page also provides you with quick access to view the run time of your previous exports and the next time and export will run. Here's an example showing the run history.

Tutorial - Create and manage exported data from Cost Management - Microsoft Cost Management (10)

Select an export to view its run history.

Tutorial - Create and manage exported data from Cost Management - Microsoft Cost Management (11)

Export runs twice a day for the first five days of the month

If you've created a daily export, you'll have two runs per day for the first five days of each month. One run executes and creates a file with the current month’s cost data. It's the run that's available for you to see in the run history. A second run also executes to create a file with all the costs from the prior month. The second run isn't currently visible in the run history. Azure executes the second run to ensure that your latest file for the past month contains all charges exactly as seen on your invoice. It runs because there are cases where latent usage and charges are included in the invoice up to 72 hours after the calendar month has closed. To learn more about Cost Management usage data updates, see Cost and usage data updates and retention.

Access exported data from other systems

One of the purposes of exporting your Cost Management data is to access the data from external systems. You might use a dashboard system or other financial system. Such systems vary widely so showing an example wouldn't be practical. However, you can get started with accessing your data from your applications at Introduction to Azure Storage.

Next steps

In this tutorial, you learned how to:

  • Create a daily export
  • Verify that data is collected
(Video) Azure Cost Management Tutorial

Advance to the next tutorial to optimize and improve efficiency by identifying idle and underutilized resources.

Review and act on optimization recommendations

FAQs

How do I export data from Azure cost management? ›

To create or view a data export or to schedule an export, choose a scope in the Azure portal and select Cost analysis in the menu. For example, navigate to Subscriptions, select a subscription from the list, and then select Cost analysis in the menu. At the top of the Cost analysis page, select Settings, then Exports.

Which of the following is required to use Azure cost management? ›

To enable Cost Management in the Azure portal, you must have confirmed customer acceptance of the Microsoft Customer Agreement (on behalf of the customer) and transitioned the customer to the Azure Plan. Only the costs for subscriptions that are transitioned to the Azure plan are available in Cost Management.

Which file is used for exporting data to Azure SQL Database? ›

A BACPAC file is a ZIP file with an extension of BACPAC containing the metadata and data from the database. A BACPAC file can be stored in Azure Blob storage or in local storage in an on-premises location and later imported back into Azure SQL Database, Azure SQL Managed Instance, or a SQL Server instance.

Which file is used for exporting and exporting data to Azure SQL Database? ›

The Bulk Copy Program (BCP) utility can move bulk data between SQL Server instances. You can export SQL Server data into BCP files. You can also use them for moving data from on-premises SQL Server instances to Azure SQL Database.

What are the three methods of allocating service department costs? ›

There are three methods for allocating service department costs: direct, sequential, and reciprocal.

What are the 3 pricing models of Azure? ›

Azure Pricing Models

Microsoft offers three main ways to pay for Azure VMs and other cloud resources: pay as you go, reserved instances, and spot instances.

What is the cheapest way to store data in Azure? ›

Consider Azure Blob Storage Block Blobs instead of storing binary image data in Azure SQL Database. Blob storage is cheaper than Azure SQL Database. If your design requires SQL, store a lookup table in SQL Database and retrieve the document when needed to serve it to the user in your application middle tier.

How do I export data from Microsoft Azure? ›

Create an export job in your source storage account in Azure portal. Specify source blobs or container paths for the data to be exported. Provide the return address and carrier account number for shipping the drives back to you. Ship the disk drives to the shipping address provided during job creation.

How do I export data from Azure to Active Directory? ›

Sign in to the Azure AD portal with a user admin or global admin account. Navigate to Azure Active Directory → Users and select the box next to the users you wish to export. Click Download users in the top-right corner of the page. In the window that opens, click Start to export the list of users as a CSV file.

What are the 3 important services offered by Azure? ›

This gives users the flexibility to use their preferred tools and technologies. In addition, Azure offers four different forms of cloud computing: infrastructure as a service (IaaS), platform as a service (PaaS), software as a service (SaaS) and serverless functions.

What is Azure cost management tools? ›

Azure Cost Management lets you analyze past cloud usage and expenses, and predict future expenses. You can view costs in a daily, monthly, or annual trend, to identify trends and anomalies, and find opportunities for optimization and savings.

What is required to use as a cost management? ›

Planning, communication, motivation, appraisal, and decision-making are the features that make managing costs an important business procedure. Resource allocation, cost estimation, cost budgeting, and cost control are the major functions of the cost management process.

How do I export all SQL tables to CSV? ›

Right-click the name of the database from which you want to export data to a CSV file, choose Tasks, and then, Export Data.

What is SQL data export? ›

Data Export for SQL Server includes a wizard, which allows you to set SQL Server export options for each table visually (destination filename, exported fields, data formats, and much more) and a command line utility to export SQL Server data from tables and queries in one-touch.

What is the simplest cost allocation method? ›

One of the simplest allocation methods is the fixed cost allocation method. This method associates specific direct costs with cost objects.

What are the 4 types of pricing? ›

What are the 4 major pricing strategies? Value-based, competition-based, cost-plus, and dynamic pricing are all models that are used frequently, depending on the industry and business model in question.

What are the four types of pricing method? ›

What Are The '4 Pricing Methods'? There are 4 Pricing Methods that can help you put a price on what you sell: replacement cost, market comparison, discounted cash flow/net present value, and value comparison.

What are three types of storage available in Azure storage? ›

Azure Queues: A messaging store for reliable messaging between application components. Azure Tables: A NoSQL store for schemaless storage of structured data. Azure Disks: Block-level storage volumes for Azure VMs.

What is the most cost effective storage option? ›

Which of the following can be used as the MOST cost-effective storage option? Amazon Glacier is the perfect solution for this. Since the agreed time frame for retrieval is met at 8 hours, this will be the most cost effective option.

What is the difference between SQL Database and Azure SQL? ›

SQL Database has some additional features that are not available in SQL Server, such as built-in high availability, intelligence, and management. Azure SQL Database offers the following deployment options: As a single database with its own set of resources managed via a logical SQL server.

How do I export Microsoft data? ›

To export your activity data:

Go to the Microsoft account Privacy page. Select Sign in with Microsoft. Sign in to your Microsoft account, then select the Download your data tab at the top of the page. Select Create new archive to export your data.

How do you export data from a Dataverse for a team? ›

Sign into Power Apps, on the left navigation pane expand Data, and then select Tables. Select Data > Export data. Select the tables that you want to export data from, and then select Export data.

How do I export data from Active Directory? ›

Run Netwrix Auditor → Navigate to Reports → Active Directory → Active Directory State-in-Time → Choose the report you need ('User Accounts', 'Groups', 'Computer Accounts', 'Organizational Units', etc.) → “View”. To save the file, click the "Export" button → Excel → Save as → Choose a location to save it.

Can you export Active Directory users? ›

To export user information from Active Directory to a CSV file, you will need access to run the CSVDE tool on a Windows Server running Active Directory in your domain. If you want to export only a single organizational unit (OU), type the following command in the command prompt, instead of the one shown above.

How many types of services are in Azure? ›

Here are the different Azure cloud service types: Infrastructure as a Service (IaaS) Platform as a Service (PaaS) Software as a Service (SaaS)

How many types of Azure firewall are there? ›

Azure Firewall is offered in three SKUs: Standard, Premium, and Basic.

Which tool can be best used for project cost management? ›

SAP. An enterprise cannot exist without a fully integrated ERP system like SAP. It is a very suitable system for managing the business and it is supported by a great number of other application providers. A lot of project members are also using SAP for budgeting and cost control and have a good reason to do so.

What are the four tools of strategic cost management? ›

Among these tools, there are activity-based costing, target costing, Kaizen costing, product life cycle costing. Strategic cost management is effective by accurate evaluation and identification of costs in the creation of income, profitability and value creation for companies.

What is cost management give me an example? ›

Cost management plans keep all project costs in one place, including direct and indirect costs. A project manager will track these costs to ensure there are no budget overruns. A cost management plan example could be the budget for a home improvement project.

What are the 3 main methods of cost estimating? ›

Methods of Cost Estimation in Projects. 1) Expert Judgement Method. 2) Analogous Estimating Method. 3) Parametric Estimating Method.

Who is responsible for cost management? ›

Project managers are responsible for cost project management. As part of their role, they must estimate total costs, plan the budget, monitor spend, and prepare for potential risks. A project manager must remain vigilant throughout the cost management process to ensure they stay within budget and improve profitability.

How do I export my Azure AD data? ›

Sign in to the Azure AD portal with a user admin or global admin account. Navigate to Azure Active Directory → Users and select the box next to the users you wish to export. Click Download users in the top-right corner of the page. In the window that opens, click Start to export the list of users as a CSV file.

Videos

1. SAP S/4HANA Cloud, Public Edition 2302 – Product Release Highlights | Jan 23
(SAP Products & Services)
2. Working with Azure Cost Management APIs | INT175B
(Microsoft Developer)
3. Azure Cost Management Overview
(Microsoft Azure)
4. AZ-900 Episode 37 | Azure Cost Management
(Adam Marczak - Azure for Everyone)
5. Analyze costs and create budgets with Azure Cost Management | LRN246
(Microsoft Ignite)
6. Save MONEY Azure Cost Management
(Azure Academy)
Top Articles
Latest Posts
Article information

Author: Carlyn Walter

Last Updated: 03/09/2023

Views: 5840

Rating: 5 / 5 (70 voted)

Reviews: 85% of readers found this page helpful

Author information

Name: Carlyn Walter

Birthday: 1996-01-03

Address: Suite 452 40815 Denyse Extensions, Sengermouth, OR 42374

Phone: +8501809515404

Job: Manufacturing Technician

Hobby: Table tennis, Archery, Vacation, Metal detecting, Yo-yoing, Crocheting, Creative writing

Introduction: My name is Carlyn Walter, I am a lively, glamorous, healthy, clean, powerful, calm, combative person who loves writing and wants to share my knowledge and understanding with you.