docs.nginx.com
Open in
urlscan Pro
2620:1ec:bdf::45
Public Scan
URL:
https://docs.nginx.com/nginx/admin-guide/monitoring/logging/
Submission: On November 24 via api from US — Scanned from DE
Submission: On November 24 via api from US — Scanned from DE
Form analysis
0 forms found in the DOMText Content
Clear SearchLoading * F5 Sites * DevCentral Connect & learn in our hosted community * MyF5 Your key to everything F5, including support, registration keys, and subscriptions * NGINX Learn more about NGINX Open Source and read the community blog 1. Home 2. F5 NGINX Plus 3. Admin Guide 4. Monitoring Configuring Logging F5 NGINX PLUS Admin Guide * Installing NGINX and NGINX Plus * Installing NGINX Plus * Installing NGINX Open Source * Installing NGINX Plus AMIs on Amazon EC2 * Installing NGINX Plus on the Google Cloud Platform * Installing NGINX Plus on Microsoft Azure * Deploying NGINX and NGINX Plus with Docker * Basic Functionality * Controlling NGINX Processes at Runtime * Creating NGINX Plus and NGINX Configuration Files * Load Balancer * HTTP Load Balancing * TCP and UDP Load Balancing * HTTP Health Checks * TCP Health Checks * UDP Health Checks * gRPC Health Checks * Dynamic Configuration of Upstreams with the NGINX Plus API * Accepting the PROXY Protocol * Content Cache * NGINX Content Caching * Web Server * Configuring NGINX and NGINX Plus as a Web Server * Serving Static Content * NGINX Reverse Proxy * Compression and Decompression * Using NGINX and NGINX Plus as an Application Gateway with uWSGI and Django * Security Controls * NGINX SSL Termination * SSL Termination for TCP Upstream Servers * Restricting Access with HTTP Basic Authentication * Authentication Based on Subrequest Result * Setting up JWT Authentication * Limiting Access to Proxied HTTP Resources * Restricting Access to Proxied TCP Resources * Restricting Access by Geographical Location * Securing HTTP Traffic to Upstream Servers * Securing TCP Traffic to Upstream Servers * Dynamic Denylisting of IP Addresses * Monitoring * Live Activity Monitoring * Configuring Logging * Debugging NGINX * NGINX Diagnostic Package * Monitoring NGINX and NGINX Plus with the New Relic Plug-In * Reporting NGINX Plus Installation Counts for Compliance * High Availability * High Availability Support for NGINX Plus in On-Premises Deployments * Configuring Active-Active High Availability and Additional Passive Nodes with keepalived * Synchronizing NGINX Configuration in a Cluster * Runtime State Sharing in a Cluster * How NGINX Plus Performs Zone Synchronization * Dynamic Modules * Dynamic Modules * Brotli * Cookie-Flag * Encrypted-Session * FIPS Status Check * GeoIP * GeoIP2 * Headers-More * HTTP Substitutions Filter * Image-Filter * Lua * NGINX Developer Kit * NGINX ModSecurity WAF * njs Scripting Language * OpenTelemetry * OpenTracing * Perl * Phusion Passenger Open Source * Prometheus-njs * RTMP * Set-Misc * SPNEGO * Uninstalling a dynamic module * XSLT * Mail Proxy * Configuring NGINX as a Mail Proxy Server Deployment Guides * Amazon Web Services * Active-Active HA for NGINX Plus on AWS Using AWS Network Load Balancer * Active-Passive HA for NGINX Plus on AWS Using Elastic IP Addresses * Global Server Load Balancing with Amazon Route 53 and NGINX Plus * Using NGINX or NGINX Plus as the Ingress Controller for Amazon Elastic Kubernetes Services * Creating Amazon EC2 Instances for NGINX Open Source and NGINX Plus * Global Server Load Balancing * Global Server Load Balancing with NS1 and NGINX Plus * Google Cloud Platform * All-Active HA for NGINX Plus on the Google Cloud Platform * Load Balancing Third-Party Servers * Load Balancing Apache Tomcat Servers with NGINX Open Source and NGINX Plus * Load Balancing Microsoft Exchange Servers with NGINX Plus * Load Balancing Node.js Application Servers with NGINX Open Source and NGINX Plus * Load Balancing Oracle E-Business Suite with NGINX Plus * Load Balancing Oracle WebLogic Server with NGINX Open Source and NGINX Plus * Load Balancing Wildfly and JBoss Application Servers with NGINX Open Source and NGINX Plus * Microsoft Azure * Active-Active HA for NGINX Plus on Microsoft Azure Using the Azure Standard Load Balancer * Creating Microsoft Azure Virtual Machines for NGINX Open Source and F5 NGINX Plus * Migrate Hardware ADCs * Migrating Load Balancer Configuration from Citrix ADC to NGINX Plus * Migrating Load Balancer Configuration from F5 BIG-IP LTM to F5 NGINX Plus * Set Up Single Sign-On for Proxied Applications * Single Sign-On with Amazon Cognito * Single Sign-On With Auth0 * Single Sign-On with Keycloak * Single Sign-On with Microsoft Active Directory FS * Single Sign-On with Okta * Single Sign-On with OneLogin * Single Sign-On with Ping Identity * Setting Up an NGINX Demo Environment * Releases * Technical Specs * Open Source Components * NGINX Plus FIPS Compliance * NGINX Directives Index Sidebar placeholder CONFIGURING LOGGING This article describes how to configure logging of errors and processed requests in NGINX Open Source and NGINX Plus. SETTING UP THE ERROR LOG NGINX writes information about encountered issues of different severity levels to the error log. The error_log directive sets up logging to a particular file, stderr, or syslog and specifies the minimal severity level of messages to log. By default, the error log is located at logs/error.log (the absolute path depends on the operating system and installation), and messages from all severity levels above the one specified are logged. The configuration below changes the minimal severity level of error messages to log from error to warn: Copy error_log logs/error.log warn; In this case, messages of warn, error crit, alert, and emerg levels are logged. The default setting of the error log works globally. To override it, place the error_log directive in the main (top-level) configuration context. Settings in the main context are always inherited by other configuration levels (http, server, location). The error_log directive can be also specified at the http, stream, server and location levels and overrides the setting inherited from the higher levels. In case of an error, the message is written to only one error log, the one closest to the level where the error has occurred. However, if several error_log directives are specified on the same level, the message are written to all specified logs. > Note: The ability to specify multiple error_log directives on the same > configuration level was added in NGINX Open Source version 1.5.2. SETTING UP THE ACCESS LOG NGINX writes information about client requests in the access log right after the request is processed. By default, the access log is located at logs/access.log, and the information is written to the log in the predefined combined format. To override the default setting, use the log_format directive to change the format of logged messages, as well as the access_log directive to specify the location of the log and its format. The log format is defined using variables. The following examples define the log format that extends the predefined combined format with the value indicating the ratio of gzip compression of the response. The format is then applied to a virtual server that enables compression. Copy http { log_format compression '$remote_addr - $remote_user [$time_local] ' '"$request" $status $body_bytes_sent ' '"$http_referer" "$http_user_agent" "$gzip_ratio"'; server { gzip on; access_log /spool/logs/nginx-access.log compression; ... } } Another example of the log format enables tracking different time values between NGINX and an upstream server that may help to diagnose a problem if your website experience slowdowns. You can use the following variables to log the indicated time values: * $upstream_connect_time – The time spent on establishing a connection with an upstream server * $upstream_header_time – The time between establishing a connection and receiving the first byte of the response header from the upstream server * $upstream_response_time – The time between establishing a connection and receiving the last byte of the response body from the upstream server * $request_time – The total time spent processing a request All time values are measured in seconds with millisecond resolution. Copy http { log_format upstream_time '$remote_addr - $remote_user [$time_local] ' '"$request" $status $body_bytes_sent ' '"$http_referer" "$http_user_agent"' 'rt=$request_time uct="$upstream_connect_time" uht="$upstream_header_time" urt="$upstream_response_time"'; server { access_log /spool/logs/nginx-access.log upstream_time; ... } } When reading the resulting time values, keep the following in mind: * When a request is processed through several servers, the variable contains several values separated by commas * When there is an internal redirect from one upstream group to another, the values are separated by semicolons * When a request is unable to reach an upstream server or a full header cannot be received, the variable contains 0 (zero) * In case of internal error while connecting to an upstream or when a reply is taken from the cache, the variable contains - (hyphen) Logging can be optimized by enabling the buffer for log messages and the cache of descriptors of frequently used log files whose names contain variables. To enable buffering use the buffer parameter of the access_log directive to specify the size of the buffer. The buffered messages are then written to the log file when the next log message does not fit into the buffer as well as in some other cases. To enable caching of log file descriptors, use the open_log_file_cache directive. Similar to the error_log directive, the access_log directive defined on a particular configuration level overrides the settings from the previous levels. When processing of a request is completed, the message is written to the log that is configured on the current level, or inherited from the previous levels. If one level defines multiple access logs, the message is written to all of them. ENABLING CONDITIONAL LOGGING Conditional logging allows excluding trivial or unimportant log entries from the access log. In NGINX, conditional logging is enabled by the if parameter to the access_log directive. This example excludes requests with HTTP status codes 2xx (Success) and 3xx (Redirection): Copy map $status $loggable { ~^[23] 0; default 1; } access_log /path/to/access.log combined if=$loggable; USECASE: SAMPLING TLS PARAMETERS Many clients use TLS versions older than TLS 1.3. Though many ciphers are declared insecure, older implementations still use them; ECC certificates offer greater performance than RSA, but not all clients can accept ECC. Many TLS attacks rely on a “man in the middle” who intercepts the cipher negotiation handshake and forces the client and server to select a less secure cipher. Therefore, it’s important to configure F5 NGINX Plus to not support weak or legacy ciphers, but doing so may exclude legacy clients. You can evaluate the SSL data obtained from the client and determine what proportion of clients get excluded if support for older SSL protocols and ciphers is removed. The following configuration example logs the SSL protocol, cipher, and User-Agent header of any connected TLS client, assuming that each client selects the most recent protocol and most secure ciphers it supports. In this example, each client is identified by its unique combination of IP address and User-Agent. 1. Define the custom log format sslparams that includes the version of the SSL protocol ($ssl_protocol), ciphers used in the connection ($ssl_cipher), the client IP address ($remote_addr), and the value of standard User Agent HTTP request field ($http_user_agent): Copy log_format sslparams '$ssl_protocol $ssl_cipher ' '$remote_addr "$http_user_agent"'; 2. Define a key-value storage that will keep the IP address of the client and its User Agent, for example, clients: Copy keyval_zone zone=clients:80m timeout=3600s; 3. Create a variable, for example, $seen for each unique combination of $remote_addr and User-Agent header: Copy keyval $remote_addr:$http_user_agent $seen zone=clients; server { listen 443 ssl; ssl_protocols TLSv1 TLSv1.1 TLSv1.2; ssl_ciphers HIGH:!aNULL:!MD5; if ($seen = "") { set $seen 1; set $logme 1; } access_log /tmp/sslparams.log sslparams if=$logme; # ... } 4. View the log file generated with this configuration: Copy TLSv1.2 AES128-SHA 1.1.1.1 "Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Firefox/45.0" TLSv1.2 ECDHE-RSA-AES128-GCM-SHA256 2.2.2.2 "Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1" TLSv1.2 ECDHE-RSA-AES128-GCM-SHA256 3.3.3.3 "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:58.0) Gecko/20100101 Firefox/58.0" TLSv1.2 ECDHE-RSA-AES128-GCM-SHA256 4.4.4.4 "Mozilla/5.0 (Android 4.4.2; Tablet; rv:65.0) Gecko/65.0 Firefox/65.0" TLSv1 AES128-SHA 5.5.5.5 "Mozilla/5.0 (Android 4.4.2; Tablet; rv:65.0) Gecko/65.0 Firefox/65.0" TLSv1.2 ECDHE-RSA-CHACHA20-POLY1305 6.6.6.6 "Mozilla/5.0 (Linux; U; Android 5.0.2; en-US; XT1068 Build/LXB22.46-28) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/57.0.2987.108 UCBrowser/12.10.2.1164 Mobile Safari/537.36" 5. Process the log file to determine the spread of data: Copy cat /tmp/sslparams.log | cut -d ' ' -f 2,2 | sort | uniq -c | sort -rn | perl -ane 'printf "%30s %s\n", $F[1], "="x$F[0];' In this output, low‑volume, less secure ciphers are identified: Copy ECDHE-RSA-AES128-GCM-SHA256 ========================= ECDHE-RSA-AES256-GCM-SHA384 ======== AES128-SHA ==== ECDHE-RSA-CHACHA20-POLY1305 == ECDHE-RSA-AES256-SHA384 == Then you can check the logs to determine which clients are using these ciphers and then make a decision about removing these ciphers from the NGINX Plus configuration. For more information about sampling requests with NGINX conditional logging see the blog post. LOGGING TO SYSLOG The syslog utility is a standard for computer message logging and allows collecting log messages from different devices on a single syslog server. In NGINX, logging to syslog is configured with the syslog: prefix in error_log and access_log directives. Syslog messages can be sent to a server= which can be a domain name, an IP address, or a UNIX-domain socket path. A domain name or IP address can be specified with a port to override the default port, 514. A UNIX-domain socket path can be specified after the unix: prefix: Copy error_log syslog:server=unix:/var/log/nginx.sock debug; access_log syslog:server=[2001:db8::1]:1234,facility=local7,tag=nginx,severity=info; In the example, NGINX error log messages are written to a UNIX domain socket at the debug logging level, and the access log is written to a syslog server with an IPv6 address and port 1234. The facility= parameter specifies the type of program that is logging the message. The default value is local7. Other possible values are: auth, authpriv, daemon, cron, ftp, lpr, kern, mail, news, syslog, user, uucp, local0 ... local7. The tag= parameter applies a custom tag to syslog messages (nginx in our example). The severity= parameter sets the severity level of syslog messages for access log. Possible values in order of increasing severity are: debug, info, notice, warn, error (default), crit, alert, and emerg. Messages are logged at the specified level and all more severe levels. In our example, the severity level error also enables crit, alert, and emerg levels to be logged. LIVE ACTIVITY MONITORING NGINX Plus provides a real-time live activity monitoring interface that shows key load and performance metrics of your HTTP and TCP upstream servers. See the Live Activity Monitoring article for more information. To learn more about NGINX Plus, please visit the Products page. -------------------------------------------------------------------------------- Last modified August 22, 2024 * * WHAT'S ON THIS PAGE * Setting Up the Error Log * Setting Up the Access Log * Enabling Conditional Logging * Usecase: Sampling TLS Parameters * Logging to Syslog * Live Activity Monitoring Found a bug? Looking for something new? Let Us Know Company * About F5 NGINX * Events Resources * Blog * FAQ * Professional Services * Training Products * F5 NGINX One * F5 NGINX Plus * F5 NGINX App Protect * F5 NGINX Instance Manager * F5 NGINX Ingress Controller * F5 NGINX Gateway Fabric * F5 NGINXaaS for Azure NGINX on GitHub * NGINX Open Source * NGINX Unit * NGINX Amplify * NGINX Agent * NGINX Kubernetes Ingress Controller * NGINX Gateway Fabric Social * * * * ©2024 F5, Inc. All rights reserved. Trademarks Policies Open Source Components Privacy California Privacy Do Not Sell My Personal Information Cookie-Präferenzen Wir respektieren Ihre Privatsphäre Um Ihnen ein optimales Erlebnis bieten zu können, verwenden wir Technologien von Drittanbietern, um die Ihnen angezeigten Inhalte zu personalisieren, und um besser zu verstehen, welche Inhalte für Sie wichtig sind. Weitere Informationen finden Sie in unserer Datenschutzerklärung. Einstellungen ändern Nein, danke Ich bin dabei