Azure Monitor data sources and data collection methods - Azure Monitor (2024)

  • Article

Azure Monitor is based on a common monitoring data platform that allows different types of data from multiple types of resources to be analyzed together using a common set of tools. Currently, different sources of data for Azure Monitor use different methods to deliver their data, and each typically require different types of configuration. This article describes common sources of monitoring data collected by Azure Monitor and their data collection methods. Use this article as a starting point to understand the option for collecting different types of data being generated in your environment.

Important

There is a cost for collecting and retaining most types of data in Azure Monitor. To minimize your cost, ensure that you don't collect any more data than you require and that your environment is configured to optimize your costs. See Cost optimization in Azure Monitor for a summary of recommendations.

Azure resources

Most resources in Azure generate the monitoring data described in the following table. Some services will also have other data that can be collected by enabling other features of Azure Monitor (described in other sections in this article). Regardless of the services that you're monitoring though, you should start by understanding and configuring collection of this data.

Create diagnostic settings for each of the following data types can be sent to a Log Analytics workspace, archived to a storage account, or streamed to an event hub to send it to services outside of Azure. See Create diagnostic settings in Azure Monitor.

Data typeDescriptionData collection method
Activity logThe Activity log provides insight into subscription-level events for Azure services including service health records and configuration changes.Collected automatically. View in the Azure portal or create a diagnostic setting to send it to other destinations. Can be collected in Log Analytics workspace at no charge. See Azure Monitor activity log.
Platform metricsPlatform metrics are numerical values that are automatically collected at regular intervals for different aspects of a resource. The specific metrics vary for each type of resource.Collected automatically and stored in Azure Monitor Metrics. View in metrics explorer or create a diagnostic setting to send it to other destinations. See Azure Monitor Metrics overview and Supported metrics with Azure Monitor for a list of metrics for different services.
Resource logsProvide insight into operations that were performed within an Azure resource. The content of resource logs varies by the Azure service and resource type.You must create a diagnostic setting to collect resources logs. See Azure resource logs and Supported services, schemas, and categories for Azure resource logs for details on each service.

Log data from Microsoft Entra ID

Audit logs and sign in logs in Microsoft Entra ID are similar to the activity logs in Azure Monitor. Use diagnostic settings to send the activity log to a Log Analytics workspace, to archive it to a storage account, or to stream to an event hub to send it to services outside of Azure. See Configure Microsoft Entra diagnostic settings for activity logs.

Data typeDescriptionData collection method
Audit logs
Signin logs
Enable you to assess many aspects of your Microsoft Entra ID environment, including history of sign-in activity, audit trail of changes made within a particular tenant, and activities performed by the provisioning service.Collected automatically. View in the Azure portal or create a diagnostic setting to send it to other destinations.

Apps and workloads

Application data

Application monitoring in Azure Monitor is done with Application Insights, which collects data from applications running on various platforms in Azure, another cloud, or on-premises. When you enable Application Insights for an application, it collects metrics and logs related to the performance and operation of the application and stores it in the same Azure Monitor data platform used by other data sources.

See Application Insights overview for further details about the data that Application insights collected and links to articles on onboarding your application.

Data typeDescriptionData collection method
LogsOperational data about your application including page views, application requests, exceptions, and traces. Also includes dependency information between application components to support Application Map and data correlation.Application logs are stored in a Log Analytics workspace that you select as part of the onboarding process.
MetricsNumeric data measuring the performance of your application and user requests measured over intervals of time.Metric data is stored in both Azure Monitor Metrics and the Log Analytics workspace.
TracesTraces are a series of related events tracking end-to-end requests through the components of your application.Traces are stored in the Log Analytics workspace for the app.

Infrastructure

Virtual machine data

Azure virtual machines create the same activity logs and platform metrics as other Azure resources. In addition to this host data though, you need to monitor the guest operating system and the workloads running on it, which requires the Azure Monitor agent or SCOM Managed Instance. The following table includes the most common data to collect from VMs. See Monitor virtual machines with Azure Monitor: Collect data for a more complete description of the different kinds of data you can collect from virtual machines.

Data typeDescriptionData collection method
Windows EventsLogs for the client operating system and different applications on Windows VMs.Deploy the Azure Monitor agent (AMA) and create a data collection rule (DCR) to send data to Log Analytics workspace. See Collect data with Azure Monitor Agent.
SyslogLogs for the client operating system and different applications on Linux VMs.Deploy the Azure Monitor agent (AMA) and create a data collection rule (DCR) to send data to Log Analytics workspace. See Collect Syslog events with Azure Monitor Agent. To use the VM as a Syslog forwarder, see Tutorial: Forward Syslog data to a Log Analytics workspace with Microsoft Sentinel by using Azure Monitor Agent
Client Performance dataPerformance counter values for the operating system and applications running on the virtual machine.Deploy the Azure Monitor agent (AMA) and create a data collection rule (DCR) to send data to Azure Monitor Metrics and/or Log Analytics workspace. See Collect data with Azure Monitor Agent.

Enable VM insights to send predefined aggregated performance data to Log Analytics workspace. See Enable VM Insights overview for installation options.

Processes and dependenciesDetails about processes running on the machine and their dependencies on other machines and external services. Enables the map feature in VM insights.Enable VM insights on the machine with the processes and dependencies option. See Enable VM Insights overview for installation options.
Text logsApplication logs written to a text file.Deploy the Azure Monitor agent (AMA) and create a data collection rule (DCR) to send data to Log Analytics workspace. See Collect logs from a text or JSON file with Azure Monitor Agent.
IIS logsLogs created by Internet Information Service (IIS).Deploy the Azure Monitor agent (AMA) and create a data collection rule (DCR) to send data to Log Analytics workspace. See Collect IIS logs with Azure Monitor Agent.
SNMP trapsWidely deployed management protocol for monitoring and configuring Linux devices and appliances.See Collect SNMP trap data with Azure Monitor Agent.
Management pack dataIf you have an existing investment in SCOM, you can migrate to the cloud while retaining your investment in existing management packs using SCOM MI.SCOM MI stores data collected by management packs in an instance of SQL MI. See Configure Log Analytics for Azure Monitor SCOM Managed Instance to send this data to a Log Analytics workspace.

Kubernetes cluster data

Azure Kubernetes Service (AKS) clusters create the same activity logs and platform metrics as other Azure resources. In addition to this host data though, they generate a common set of cluster logs and metrics that you can collect from your AKS clusters and Arc-enabled Kubernetes clusters.

Data typeDescriptionData collection method
Cluster MetricsUsage and performance data for the cluster, nodes, deployments, and workloads.Enable managed Prometheus for the cluster to send cluster metrics to an Azure Monitor workspace. See Enable Prometheus and Grafana for onboarding and Default Prometheus metrics configuration in Azure Monitor for a list of metrics that are collected by default.
LogsStandard Kubernetes logs including events for the cluster, nodes, deployments, and workloads.Enable Container insights for the cluster to send container logs to a Log Analytics workspace. See Enable Container insights for onboarding and Configure data collection in Container insights using data collection rule to configure which logs are collected.

Custom sources

For any monitoring data that you can't collect with the other methods described in this article, you can use the APIs in the following table to send data to Azure Monitor.

Data typeDescriptionData collection method
LogsCollect log data from any REST client and store in Log Analytics workspace.Create a data collection rule to define destination workspace and any data transformations. See Logs ingestion API in Azure Monitor.
MetricsCollect custom metrics for Azure resources from any REST client.See Send custom metrics for an Azure resource to the Azure Monitor metric store by using a REST API.

Next steps

  • Learn more about the types of monitoring data collected by Azure Monitor and how to view and analyze this data.
Azure Monitor data sources and data collection methods - Azure Monitor (2024)

FAQs

Can Azure Monitor collect data from any source? ›

Azure Monitor collects and aggregates the data from every layer and component of your system across multiple Azure and non-Azure subscriptions and tenants. It stores it in a common data platform for consumption by a common set of tools that can correlate, analyze, visualize, and/or respond to the data.

What are the two main kinds of data Azure Monitor works with? ›

All data collected by Azure Monitor fits into one of two fundamental types: metrics and logs. Metrics are numerical values that describe some aspect of a system at a particular point in time. They are lightweight and capable of supporting near real-time scenarios.

What are the different types of monitoring in Azure? ›

Some examples of the data sets that Azure monitoring tools will analyze include:
  • Application monitoring data. ...
  • Azure resource monitoring data. ...
  • Azure tenant monitoring data. ...
  • Azure subscription monitoring data. ...
  • Virtual machine and cloud services data. ...
  • Application insight data. ...
  • Azure Active Directory reporting data.

What data is collected by Azure Monitor? ›

Azure Monitor agent (AMA) is used to collect data from Azure virtual machines, Virtual Machine scale sets, and Arc-enabled servers. Data collection rules (DCR) define the data to collect from the agent and where that data should be sent.

Is Azure Monitor same as log analytics? ›

Log Analytics workspaces contain logs and metrics data from multiple Azure resources, whereas Azure Monitor workspaces currently contain only metrics related to Prometheus.

How do you monitor Azure resources? ›

You can access Azure Monitor features from the Monitor menu in the Azure portal. You can also access Azure Monitor features directly from the menu for different Azure services. Different Azure services might have slightly different experiences, but they share a common set of monitoring options in the Azure portal.

What are the two data types of Azure Monitor? ›

What data types does Azure Monitor collect?
  • Application data: Data that relates to the custom application code. ...
  • Operating System data: Data regarding the operating system in which the application is running i.e., data from the Windows or Linux virtual machines that host your application.

What are the features of Azure Monitor? ›

Azure Monitor has three core components:
  • Application insights, used to monitor web applications.
  • Log analytics, used to query and analyze logged event data.
  • Alerts, used to set up automatic notifications and actions when issues are detected.

What is the difference between Azure Monitor and Azure Sentinel? ›

Azure Monitor primarily focuses on operational data like application logs, Azure activity logs, and performance metrics. Conversely, Azure Sentinel is designed to work with a more comprehensive range of data, including but not limited to security events, threat intelligence, and cloud application data.

What are the three monitoring methods? ›

In the world of monitoring and evaluation (M&E) three approaches can be identified: result-oriented, constructivist and reflexive (see table p. 32). Every approach includes principles, methods and tools that can be used for projects that have the ambition to contribute to (system) innovation.

What are the 3 types of data that can be stored in Azure? ›

Azure Storage data services
  • Azure Blobs: A massively scalable object store for text and binary data. ...
  • Azure Files: Managed file shares for cloud or on-premises deployments.
  • Azure Elastic SAN: A fully integrated solution that simplifies deploying, scaling, managing, and configuring a SAN in Azure.
Sep 3, 2024

What are data collection rules in an Azure monitor? ›

Data collection rules (DCRs) are sets of instructions that determine how to collect and process telemetry sent to Azure Monitor.

What are the two types of data collected in an Azure monitor from your environment? ›

Application data
Data typeDescription
MetricsNumeric data measuring the performance of your application and user requests measured over intervals of time.
TracesTraces are a series of related events tracking end-to-end requests through the components of your application.
1 more row

What is the Azure monitor data collection endpoint? ›

A data collection endpoint (DCE) is a connection where data sources send collected data for processing and ingestion into Azure Monitor.

What services can provide data to an Azure monitor? ›

Azure Monitor receives data from target resources like applications, operating systems, Azure resources, Azure subscriptions, and Azure tenants. The nature of the resource defines which data types are available. A data type will be a metric, a log, or both a metric and a log.

Which services can be integrated with Azure monitor? ›

  • Azure Arc​
  • Microsoft Sentinel.
  • Azure SQL.
  • Microsoft Defender for Cloud.
  • Azure ExpressRoute.
  • Azure DevOps.
  • Azure Database for PostgreSQL.
  • Azure IoT Edge.

Why can't the operating system of an instance be monitored by using an Azure monitor? ›

The statement that 'the operating system of an instance cannot be monitored by using Azure Monitor' could have multiple explanations; however, given the options, the most valid explanation seems to be that the old operating system is not capable of supplying well-organized data which is critical for monitoring purposes ...

What is the difference between Azure monitor and application insights? ›

In summary, Azure Application Insights focuses on monitoring the performance and user behavior of applications, while Azure Monitor provides a broader scope of monitoring for applications, infrastructure, and operating systems.

Top Articles
Pay bills online from QuickBooks Desktop
Polkadot (DOT) vs. Solana (SOL): Which One is Better Investment | PrimeXBT
Bild Poster Ikea
Lorton Transfer Station
Arkansas Gazette Sudoku
Zitobox 5000 Free Coins 2023
What happens if I deposit a bounced check?
Needle Nose Peterbilt For Sale Craigslist
Whiskeytown Camera
Anki Fsrs
Seth Juszkiewicz Obituary
William Spencer Funeral Home Portland Indiana
Cool Math Games Bucketball
Blue Beetle Showtimes Near Regal Swamp Fox
OpenXR support for IL-2 and DCS for Windows Mixed Reality VR headsets
Moparts Com Forum
Morgan And Nay Funeral Home Obituaries
Condogames Xyz Discord
Costco Gas Foster City
Swgoh Turn Meter Reduction Teams
E22 Ultipro Desktop Version
Lonesome Valley Barber
Aps Day Spa Evesham
Shopmonsterus Reviews
Myhr North Memorial
The Largest Banks - ​​How to Transfer Money With Only Card Number and CVV (2024)
4 Times Rihanna Showed Solidarity for Social Movements Around the World
What Is Opm1 Treas 310 Deposit
First Light Tomorrow Morning
Sports Clips Flowood Ms
Song That Goes Yeah Yeah Yeah Yeah Sounds Like Mgmt
Today's Final Jeopardy Clue
Terrier Hockey Blog
Retire Early Wsbtv.com Free Book
Aveda Caramel Toner Formula
Miracle Shoes Ff6
Shuaiby Kill Twitter
Sept Month Weather
Letter of Credit: What It Is, Examples, and How One Is Used
Lcwc 911 Live Incident List Live Status
Luvsquad-Links
Home Auctions - Real Estate Auctions
Shipping Container Storage Containers 40'HCs - general for sale - by dealer - craigslist
Lyndie Irons And Pat Tenore
Tropical Smoothie Address
Stephen Dilbeck, The First Hicks Baby: 5 Fast Facts You Need to Know
Rovert Wrestling
17 of the best things to do in Bozeman, Montana
Craigslist Pets Lewiston Idaho
The Missile Is Eepy Origin
San Pedro Sula To Miami Google Flights
Pauline Frommer's Paris 2007 (Pauline Frommer Guides) - SILO.PUB
Latest Posts
Article information

Author: Lidia Grady

Last Updated:

Views: 5917

Rating: 4.4 / 5 (65 voted)

Reviews: 88% of readers found this page helpful

Author information

Name: Lidia Grady

Birthday: 1992-01-22

Address: Suite 493 356 Dale Fall, New Wanda, RI 52485

Phone: +29914464387516

Job: Customer Engineer

Hobby: Cryptography, Writing, Dowsing, Stand-up comedy, Calligraphy, Web surfing, Ghost hunting

Introduction: My name is Lidia Grady, I am a thankful, fine, glamorous, lucky, lively, pleasant, shiny person who loves writing and wants to share my knowledge and understanding with you.