Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

Chapter II Operation and definition of Zabbix

2025-02-22 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >

Share

Shulou(Shulou.com)06/02 Report--

Chapter II Zabbix Web Operation and definition

This chapter introduces the definition of some basic concepts in Zabbix and the operation of web front-end pages, including the definition of some terms used in Zabbix, the management of users, hosts and host groups in Web pages, as well as the management and operation of monitoring items, templates, triggers, alarms, as well as Graphs, Screens, Maps and Reports. Through the study of this chapter, we can master some basic concepts and be able to manage Zabbix through the operation of the Web page.

2.1 definition

Hosts (host)

The servers, switches and other devices that need to be monitored in the Zabbix are all called host. These devices are connected to the Zabbix server through the network. Manage hosts in the Configuration-- > Hosts page. This is the intention of all the hosts mentioned in this book.

Host groups (host group)

For ease of management, hosts with the same attributes can be classified, and host groups can contain hosts and templates. The classification can be divided according to geographical area, business unit, equipment use, application type and so on. Manage the configuration in the Configuration-- > Host groups page.

Item (monitoring item)

The metrics to be monitored, such as CPU load, memory utilization, etc., are called item in Zabbix, and monitoring items can be included in the host or template. You can manage the configuration in the Configuration-- > Hosts-- > items page or the Configuration-- > Templates-- > items page.

Template (template)

Items (monitoring item), triggers (trigger), screens (display screen), graphs (graphics), application (monitoring item group), low-level discovery (low-level discovery) and webscenarios (web scene) can be added to the template. Hosts with the same monitoring requirements can use the same template, and the template can be used to automate configuration and complete monitoring tasks in batches. Manage the configuration in the Configuration-- > Templates page.

Trigger (trigger)

When we collect the data of the monitoring item, we can use logical expressions to evaluate the state of the data of the monitoring item, and judge whether it is normal according to the thresholds (threshold) we set. The result is OK (normal) or PROBLEM (fault), and the trigger can be included in the host or template. Manage the configuration in the Configuration-- > Hosts-- > Triggers page or the Configuration-- > Templates-- > Triggers page.

Events (event)

When the result of a trigger changes (that is, the state of the trigger changes from OK to PROBLEM or from PROBLEM to OK), an event is generated in Zabbix. Agent auto-registration (agent auto-registration) and network device auto discovery (auto-discovery) also generate events. You can view the event details in the Monitoring-- > Events page.

Action (Action)

Sometimes we take an action based on a specific event, such as sending an alert email when the state of a trigger changes to PROBLEM. An action consists of an operation (operation) and a condition (condition). Manage the configuration in Configuration-- > Actions.

Escalation (alarm upgrade)

In the actual environment, sometimes you need to send an alarm to different people according to the situation. For example, send an alarm email to the administrator after a failure, and send an alarm email to the administrator every 10 minutes. If the failure remains unresolved after 30 minutes, send an alarm email to the department manager. We can configure it in the Operations tag in the Configuration-- > Actions page.

Media (alarm mode)

Zabbix supports a variety of alarm methods, including E-mail (email), SMS (SMS), Jabber, EZ Texting (used abroad only) and custom alarm methods. Through the extension, you can use Wechat and nails to send alarms, and configure them on the Administration-> Media Types page.

Remote commands (remote command)

Remote commands are commands or Scripts (scripting programs) executed on Zabbix server and monitored hosts to perform specific tasks, such as restarting Apache services. Configure in Administration-- > Scripts.

Applications (Monitoring item Group)

There is a corresponding user group when managing users in Zabbix, a corresponding host group when managing the host, and a corresponding monitoring item group when managing monitoring items, that is, applications. Configure it in Configuration-- > Hosts-- > Applications or Configuration-- > Templates-- > Applications.

Notification (Notification)

Alarm information about events, trigger status, etc., sent through the alarm method selected by the user.

Severity (alarm level)

In Zabbix, different severity levels of triggers are defined through Severity. By default, there are 6 values, which are Not classified,nformation,Warning,Average,High,Disaster.

Recently, we have completed the recording and release of the video tutorial "zabbix 4.0", which is based on zabbix 4.2 and provides a comprehensive explanation of Zabbix. Welcome to watch. Course link: https://edu.51cto.com/sd/ce000

2.2 Zabbix Web front-end operation

The Zabbix web page is mainly divided into four functional areas, as shown in figure 2-1 below.

Figure 2-1

1. Main menu: it consists of Zabbix logo and Monitoring (monitoring data), Inventory (asset record), Reports (report), Configuration (configuration) and Administration (management) menu. Configuration and Administration menu items are not displayed when Guest users log in.

two。 User-related menus: including search boxes, help, user configuration and exit buttons.

3. Submenu: secondary menu, the content varies with the choice of the main menu.

4. Operation area: different operation contents will appear in this area according to the selection of different menu items.

2.2.1 Monitoring2.2.1.1 Dashboard

The Dashboard (dashboard) page is divided into three columns: the left, the middle and the right. Only the left and middle columns have content in the system default page, and the column on the right is empty. When users log in to the front-end Zabbix Web page, the page is displayed by default, and each user can customize the content displayed in the dashboard and adjust the rate of page refresh according to their own needs. This is shown in figure 2-2 below.

Figure 2-2

At the top right of the page is the configuration button for the dashboard.

It's a full-screen button. On the left side of the page are three information windows: Favouritegraphs (commonly used graphics), Favouritescreens (commonly used display screen) and Favourite maps (commonly used topology diagram). In the middle is Status ofZabbix (Zabbix server status), System status (system status), Host status (host status), Last 20issues (last 20 questions) and Web monitoring (Web monitoring) information windows. The position and order of these information windows on the page can be adjusted by dragging the mouse.

Click the button to configure the current user's dashboard, as shown in figure 2-3 below.

Figure 2-3

In the dashboard configuration page, the default setting for Dashboard filter is Disabled (disabled), that is, filtering is not enabled. When you click Disabled and change to Enabled, you can select the hosts and triggers that need to be displayed in the Dashboard, thus solving the problem of too much content on the page. Click the Update button to save when the settings are complete, and the configuration button on the dashboard page will change to

There is a green dot in the upper-right corner of the icon indicating that the dashboard filter is enabled and not all the information is displayed on the current page.

Favourite (favorite) information window can add graphics, display screen, slide show and topology diagram of the common shortcut links, the right mouse button click the button in the upper right corner of the form, you can choose to add or delete common links in the pop-up menu. Click the button to collapse the current form.

Take Favourite graphs as an example, click the menu button in the upper right corner of the form, and it appears as shown in figure 2-4.

Figure 2-4

The pop-up menu is divided into two parts: FAVOURITE GRAPHS and FAVOURITESIMPLE GRAPHS,Add are commonly used shortcut links to add new ones, Remove is to delete common shortcut links that have been added, and Remove all is to delete all common shortcut links that have been added. What is added in the FAVOURITE GRAPHS is the graph we created, while what is added in the FAVOURITE SIMPLE GRAPHS is the graph automatically generated by the monitoring item.

In addition, when we browse the graph in the view Monitoring-> Graphs page, clicking the button in the upper right corner will add the graph to the Favourite graphs, as shown in figure 2-5 below.

Figure 2-5

When we go back to the dashboard, we can see the graphic zabbix server:CPU jumps we just added in Favourite graphs, with the name format {HOST NAME}: {GRAPH NAME}. This is shown in figure 2-6 below.

Figure 2-6

The shortcut links added in Favourite are bound to the user's account, and each user only needs to add the shortcut links he or she cares about.

The Status of Zabbix information window displays the information related to the current Zabbix server. Click the button in the upper right corner, and you can select the time to refresh the content in the pop-up menu, as shown in figure 2-7 below.

Figure 2-7

The items in figure 2-7 are illustrated as follows:

The running status of the u Zabbix server is running:Zabbix server. Yes in the VALUE column indicates that the Zabbix server is running, No indicates that it is not running, and the localhost:10051 in the DETAILS column is the IP address and port of the Zabbix server.

U Number of hosts (enabled/disabled/templates): statistics of the number of hosts and templates. The value of the VALUE column is the total. The DETAILS column shows the number of monitored hosts, the number of unmonitored hosts, and the number of templates.

U Number of items (enabled/disabled/notsupported): statistics on the number of monitoring items. The value of the VALUE column is the total. The DETAILS column shows the number of enabled, disabled and unsupported monitoring items, respectively.

U Number of triggers (enabled/disabled/ / ok): statistics of the number of triggers. The value of the VALUE column is the total. The DETAILS column shows the number of enabled triggers, the number of disabled triggers, and the number of triggers with status of PROBLEM and OK, respectively.

U Number of users (online): statistics on the number of users. The value in the VALUE column is the total number of users, and the value in the DETAILS column is the number of users currently online.

Statistics on the number of new data processed by the u Required server performance,new values per second:Zabbix server per second, which is an important indicator of Zabbix server performance.

The alarm of each host group is displayed in the System status information window, which is displayed in different columns according to the alarm level of the trigger. This is shown in figure 2-8 below.

Figure 2-8

The Host status information window displays the statistics of the number of running states of hosts in each host group, which is added to the WITHPROBLEMS column when the status of the trigger is PROBLEM and to the WITHOUT PROBLEMS column when the status is OK. This is shown in figure 2-9 below.

Figure 2-9

The Last 20 issues information window shows 20 recent trigger problems. When you mouse over the description of the ISSUE column, you will see the events related to this trigger. The value of No in the ACK column represents that the problem has not responded yet. The 1 in the ACTIONS column indicates that the problem has triggered an action. Click this value to see the detailed information. This is shown in figure 2-10 below.

Figure 2-10

The Web monitoring information window shows the Web monitoring in the host group, as shown in figure 2-11 below.

Figure 2-11

After the Discovery feature is enabled in the system, the Discovery Rule (discovery rules) operation is displayed in the Discoverystatus information window, as shown in figure 2-12 below.

Figure 2-12

2.2.1.2 Overview

In Overview, you can view trigger or monitor item data. When displaying data in Overview, it is best to filter it with application (Monitoring item Group), otherwise the amount of data will be too large to read clearly. Through the Group at the top right of the page, you can select all or a host group, Type can choose the type to view is trigger data or monitoring item data, and Host location can choose Top or Left. In Filter, if you are looking at the data of a trigger, you can filter the data by multiple conditions such as trigger status, response status, and so on. If you are viewing the data of a monitoring item, we can filter the data by selecting application. This is shown in figure 2-13 below.

Figure 2-13

2.2.1.3 Web

The Web monitoring page displays the contents of the Web monitoring defined in the Web Scenario.

2.2.1.4 Latest data

Show the latest data obtained by Zabbix server, this page should be used more. We must use Filter to filter the data, narrow the scope of the display data by using host group, host, and monitoring item groups alone or in combination, and further filter in the display results by entering keywords in the monitoring item name to minimize the displayed data. When the Show items without data option is checked, the monitoring items that do not collect data are displayed at the same time. When the Show details option is checked, information such as the type of the monitoring item and the time interval between collecting the data of the monitoring item is also displayed. At the same time, the key used by the monitoring item is displayed under the name of the monitoring item in the Name column. Click this key link to configure some parameters in the monitoring item. This is shown in figure 2-14 below.

Figure 2-14

2.2.1.5 Triggers

You can view the situation of the trigger in the Status of Triggers page. Through the Group and Host selection boxes at the top right of the page, you can select the host group and the host in it, and then further filter the trigger data through Filter and display it. This is shown in figure 2-15 below.

Figure 2-15

Description of the options in Filter:

Triggers status: Any indicates that Trigger in any state will be displayed, Recent problem that the most recent state is Problem will be displayed, and Problem that the current status is Problem will be displayed.

Acknowledge status: Any means that triggers in any state will be displayed, With unacknowledgedevents means unresponsive triggers will be displayed, and With lastevent unacknowledged means that the latest unresponsive triggers will be displayed.

Events:Hide all means to hide all events, Showall (7 days) to show all trigger events within 7 days, and Show unacknowledged (7 days) to show trigger events that have not responded within 7 days.

Minimum Trigger severity: displays triggers above the selected warning level.

Age less than: sets the number of days, showing the number of days in which triggers are generated.

Filter by name: sets the keyword and displays the trigger whose name contains the keyword.

Filter by application: displays the triggers generated by the monitoring items in the selected monitoring item group by using the monitoring item group filtering.

Filter by host inventory: displays triggers that match the items in Inventory.

Show hosts in maintenance: displays the trigger of the host during the maintenance period.

Show details: displays the details of the trigger.

Clicking the link in the LAST CHANGE column above in figure 2-15 will jump to the Events page, clicking Yes or No in the ACK column will bring up the Alarm acknowledgements page, and clicking the link in the HOST and NAME columns will bring up a shortcut menu, as shown in figure 2-16 below.

Figure 2-16

2.2.1.6 Events

The Events page displays all events from Trigger or Discovery in Zabbix. You can select the host group and host that need to view events through the Group and Host at the top right of the page, and you can choose to view events from Trigger or Discovery in Source. When viewing the events of a trigger, you can use Filter filtering to display the information of a trigger. You can export the events displayed on the page to a CSV file for further analysis and reporting by clicking the Exportto CSV button at the top right. This is shown in figure 2-17 below.

Figure 2-17

2.2.1.7 Graphs

The Graphs page displays custom graphics that have been configured in Zabbix. Select the appropriate host group and host through the Group and Host at the top right of the page, and Graph selects the graphics to be displayed. This is shown in figure 2-18 below.

Figure 2-18

2.2.1.8 Screens

The Screens page shows the Screen (display screen) and Slide shows (slide show) that we defined, and every user in Zabbix can create and manage the display screen and slide show here. Through the selection box at the top right of the page, we can select Screens or Slide shows, and use Name like in Filter to further filter and display the results. When selecting Screens, you can click the Createscreen button to create a new display screen, or click the Import button to import the display screen, and click the Export or Delete button in the lower left corner to export or delete the selected display screen. When you select Slide shows, you can click the Createslide show button to create a new slide show, or use the Delete button in the lower left corner to delete the selected slide show. This is shown in figure 2-19 below.

Figure 2-19

Each user-created display screen or slide show can be shared with other users in two ways: Private (private) or Public (public). When set to Private, only the owner or shared user can access it, and all users can access it when Public. This is shown in figure 2-20 below.

Figure 2-20

2.2.1.9 Maps

The Maps (topology diagram) we defined is displayed on the Maps page, and anyone in the Zabbix can create and manage the Maps. Click the Create map button at the top right of the page to create a new topology diagram, and click the Import button to import the topology diagram. This is shown in figure 2-21 below.

Figure 2-21

When viewing the topology diagram, you can filter the results displayed through the Name like in Filter, and like the user-created display screen, the topology diagram created by each user can be shared with other users.

2.2.1.10 Discovery

The results of the Discoveryrule (Discovery Rule) run are displayed on the Status of discovery page. The devices discovered by the rules are listed on the page, including the monitoring status of the device, the time the device is online or offline. This is shown in figure 2-22 below.

Figure 2-22

2.2.1.11 IT services

The ITservices page shows the ITservices status and SLA (service level agreement) that we defined. You can choose the time range to display through the Period in the upper right corner of the page.

Figure 2-23

2.2.2 Inventory2.2.2.1 Overview

The Host inventory overview page displays a statistical list of hosts with an asset record attribute. Select the host group through the Group in the upper right corner, and Grouping by select the asset record properties to filter and display the results. The number in the HOST COUNT column represents the number of hosts with some kind of asset record attribute, and clicking the value takes you to the Host inventory page. This is shown in figure 2-24 below.

Figure 2-24

2.2.2.2 Hosts

The Host Inventory page displays the main asset record properties of all hosts or hosts that belong to the host group, including Name, Type, OS, Serial Number A, TAG, MAC Address A. Filter allows you to further filter eligible hosts. This is shown in figure 2-25 below.

Figure 2-25

2.2.3 Reports2.2.3.1 Status of Zabbix

The information displayed in the Statusof Zabbix page is the same as that displayed in the Statusof Zabbix information window in the dashboard, which is not explained here.

2.2.3.2 Availability report

The percentage of PROBLEMS and OK status of triggers for a certain period of time is displayed on the Availability report page. Select by host (host) or by triggertemplate (trigger template) to display through the Mode in the upper right corner. You can set the start time and end time of the query in Filter (the default is 1 day), and you can further filter and display the results through host groups, hosts, template groups, templates, template triggers, etc. This is shown in figure 2-26 below.

Figure 2-26

Click the Show link in the GRAPH column to see the percentage of trigger status over the past week of the year. This is shown in figure 2-27 below.

Figure 2-27

2.2.3.3 Triggers top 100

The top 100 triggers with the most frequent state changes (from OK to PROBLEM or from PROBLEM to OK) are displayed on the 100 busiest Triggers page. You can set the start time and end time of the query in Filter (the default is 1 day), or you can further filter the display results by selecting host group, host, and alarm level. This is shown in figure 2-28 below.

Figure 2-28

2.2.3.4 Audit

The audit (audit) log is displayed on the Audit log page. Select User, Action, and Resource in Filter to further filter the display results.

2.2.3.5 Action log

The action (Action) log is displayed on the Action log page. Select Recipient (recipient) in Filter to further filter the display results.

2.2.3.6 Notifications

The Notification page shows the statistics of notifications sent by the Zabbix system. In the upper right corner, you can filter the display results through Media type, Period, and Year selections.

2.2.4 Configuration2.2.4.1 Host groups

The Host groups page lists all host groups (including templates) defined in the Zabbix system, the number of hosts contained in each host group, the number of templates, and the names of hosts and templates that belong to that group. Click the Create host group button in the upper right corner to create a new host group, or to enable, disable, or delete a host group that already exists in the system. Select one or more host groups and click the Enable hosts button in the lower left corner of the page to set the monitoring status of all hosts in the selected host group to Enable (enabled) to start monitoring; click the Disablehosts button to set the monitoring status of all hosts in the selected host group to Disable (disabled) to stop monitoring; click the Delete button to remove the selected host group from the Zabbix system. This is shown in figure 2-29 below.

Figure 2-29

2.2.4.2 Templates

The Templates page lists the templates that exist in the system and the information related to Applications, Items, Triggers, Graphs, Screens, Discovery, and Web defined in each template. Select a host group or template group in the upper-right corner Group to display the templates that belong to that group. Click the Create template button to create a new template, and the Import button allows you to import existing template definitions and configurations. When one or more templates are selected, export the definition and configuration of the template to a XML file by clicking the Export button on the lower left for later recovery or import in other systems; the Delete button deletes the selected template (the configuration of monitoring items, triggers, etc., defined in the template will not be deleted from the associated host) When the Delete and clear button deletes the template, the monitoring items, triggers and other configurations defined in the template are deleted from the associated host. This is shown in figure 2-30 below.

Figure 2-30

2.2.4.3 Hosts

In Zabbix, all the monitored devices, servers and other monitoring objects are called hosts, and we can complete the configuration and management related to the host in the Hosts page. In the list of display hosts, you can see the information of Application, Items, Triggers, Graphs, Discovery, Web defined in each host, as well as the interface, template, status and other information used by the host. Select the host group in the upper-right corner Group to filter the hosts that belong to the group, and you can use Name like, DNS like, IP like, and Port like in Filter to further filter the displayed results. Click the Create host button to create a new host, and the Import button to import host configurations exported from other Zabbix systems. When one or more hosts are selected, the monitoring of the selected hosts can be enabled by clicking the Enable button on the lower left; the Disable button can disable the monitoring of the selected hosts; the Export button can export the definition and configuration information of the selected hosts; the Massupdate button can update the configuration of the selected hosts in batches; and the Delete button can delete the selected hosts. This is shown in figure 2-31 below.

Figure 2-31

The meaning of the list content on the Hosts page is as follows:

Name: host name. Click to open the configuration page of the host.

Applications: click Applications to open the Applications administration page. The gray value after the name is the number of monitoring item groups defined and configured in the host.

Items: click Items to open the Items management page. The gray value after the name is the number of monitoring items defined and configured in the host.

Triggers: click Triggers to open the Triggers administration page, with the gray value after the name being the number of triggers defined and configured in the host.

Graphs: click Graphs to open the Graphs management page, with the gray value after the name being the number of graphics defined and configured in the host.

Discovery: click Discovery to open the Discoveryrules management page with a gray value after the name is the number of discovery rules defined and configured in the host.

Web: click Web to open the Web monitoring management page, with the gray value after the name being the number of Web scenarios defined and configured in the host.

Interface: displays the main interface currently used by the host.

Templates: displays the template connected to the host. Click the template name to open the corresponding template configuration page.

Status: displays the current host status: Enable or Disable. Click to change the status.

Availability: displays the availability status of the host, with four icons representing the Zabbix agent, SNMP, IPMI, and JMX interfaces. Green is available, red is not available, and gray is unknown. It is important to note that there is no change in the color of ZBX when you use active agent (active Agent).

Agent encryption: displays the encryption status of the connection link between Zabbix server (or proxy) and the host. None is not encrypted, PSK is encrypted using pre-shared key, and Cert is encrypted using certificate.

Info: displays an error message about the host.

2.2.4.4 Maintenance

You can configure and manage maintenance tasks on the Maintenance periods page. As shown in figure 2-32 below, the page lists the maintenance tasks that already exist in the system. Through the Group in the upper right corner, you can choose to display all maintenance tasks or maintenance tasks that belong to a host group. Click the Create maintenance period button to create a new maintenance task. Select one or more maintenance tasks and click the Delete button at the lower left to remove the selected maintenance tasks from the system.

Figure 2-32

The meaning of the list content on the Maintenanceperiods page is as follows:

U Name: maintenance task name, click to open the configuration page for that maintenance task.

U Type: displays the type of maintenance, With datacollection (data collection) or No datacollection (no data collection).

U Active since: the date and time when the maintenance task began to execute.

U Active till: the date and time when the maintenance task ends.

U State: status of the current maintenance task: Approaching is about to start, Active is in progress, and Expired is finished.

U Description: displays the description of the maintenance task.

2.2.4.5 Actions

The Actions page is mainly used to configure and manage actions. In the Event source in the upper right corner of the page, you can select event sources (Triggers, Discovery, Autoregistration, and Internal) and display the results. Click the Create action button to create a new action. After one or more actions are selected, click the Enable button at the lower left to enable the selected action, the Disable button to disable the action, and the Delete button to delete the action. This is shown in figure 2-33 below.

Figure 2-33

The meaning of the list content on the Actions page is as follows:

U NAME: the name of the action. Click to open the configuration page for the action.

U CONDITIONS: displays the conditions defined in the action.

U OPERATIONS: displays the actions defined in the action.

U STATUS: displays the status of the current action, Enable or Disable, click to change the state.

2.2.4.6 Discovery

The Discovery rules page is used to manage and configure discovery rules. Click the Create discovery rule button in the upper right corner of the page to create a new discovery rule. After selecting one or more discovery rules, click the Enable button at the lower left to enable the selected discovery rule, the Disable button to disable the discovery rule, and the Delete button to delete the discovery rule. As shown in figure 2-34 below.

Figure 2-34

The meaning of the list content on the Discoveryrules page is as follows:

U NAME: the name of the discovery rule. Click to open the configuration page for the discovery rule.

U IP RANGE: displays the range of IP addresses used for network scanning.

U DELAY: displays the frequency at which discovery rules are executed.

U CHECKS: displays the detection method for discovery rules.

U STATUS: displays the status of the discovery rule, Enable or Disable, click to change the state.

2.2.4.7 IT services

The IT services page is used to configure and maintain monitoring of the IT service. We can create multi-level service monitoring, the system is initially configured with only one root, and new services are added through the Add child button. This is shown in figure 2-35 below.

Figure 2-35

2.2.5 Administration2.2.5.1 General

The General page is mainly about some general management configuration functions in the Zabbix system, through the drop-down box in the upper right corner to select different projects to complete the relevant configuration and management. This is shown in figure 2-36 below.

Figure 2-36

1 、 GUI

The parameters related to the Web front-end page are mainly configured in the GUI page, such as the display style of the page, the default value of the drop-down box, and so on. The configuration page is shown in figure 2-37 below.

Figure 2-37

The meaning of the configuration parameters on the page is as follows:

U Default theme: the system's default page display theme style. When users set Theme to System default in their profile, the theme style of the page set by this parameter will be used after logging in to the Web frontend page (default is Blue). After changing the theme, you need to log in again to take effect.

U Dropdown first entry: the first choice in the drop-down box. In the front page, there is often the operation of selecting the drop-down box, this parameter is to set the first option of the drop-down box is All or None. In addition, remember the operation of the current drop-down box by selecting remember selected, for example, after you select Router in the Group drop-down box in the Hosts page, Router will be automatically selected in the Group drop-down box the next time you return to the Hosts page.

U Search/Filter elements limit: the number of records displayed in the list of pages when searching for or using the filter. For example, after setting the parameter to 10, when the result of the page query exceeds 10 records, it will be displayed as "Displaying 1 to 10 of 10+found", and you will see that there is an extra + sign after 10.

U Max count of elements to show inside table cell: the maximum number of elements displayed in the cells of the page table. For example, when the parameter is set to 1, only one MEMBERS (member) name is displayed in the Templates template in the Host groups page.

U Enable event acknowledges: when checked, you can see the ACK column in the Last 20 issues and Monitoring-- > Events pages of the Monitoring-- > Dashboard page, otherwise you will not see the ACK column. It is checked by default.

U Show events not older than (in days): defines how many days of events are displayed in the Monitoring-- > Triggers page. The default is 7 days.

U Max count of events per trigger to show: defines how many events are displayed per Trigger in the Monitoring-- > Triggers page. The default is 100.

U Show warning if Zabbix server is down: when checked, when Zabbix server cannot be accessed (possibly down), a warning message will be displayed in the browser to alert the user. It is checked by default.

2 、 Housekeeping

The main role of Housekeeping is to delete old data from the Zabbix database on a regular basis, including data related to events and alerts (events and alerts), IT Services (IT services), audit (auditing), user sessions (user sessions), history (history) and trends (trends). As shown in figure 2-38.

Figure 2-38

The meaning of the configuration parameters on the page is as follows:

U Enable internal housekeeping: enables or disables the Housekeeping feature.

U Trigger data storage period (in days): the number of days the trigger data is retained.

U Internal data storage period (in days): the number of days that internal data is retained.

U Network discovery data storage period (in days): the number of days that the network discovery data is retained.

U Auto-registration data storage period (in days): the number of days to retain auto-registration data.

U Data storage period (in days): the number of days to retain events and alerts, IT services, audit, user sessions, history, and trends data in the database.

U Override item history period: overrides the number of historical retention days configured in the monitoring item. If checked, the Data storageperiod (in days) set in the history on this page will override the Historystorage period (in days) configured in the monitoring item.

U Override item trend period: overrides the number of trend retention days configured in the monitoring item. If checked, the Data storage period (in days) set in the trends on this page will override the Trend storage period (in days) configured in the monitoring item.

After setting the parameters, clicking the Update button will update the set parameters, and clicking the Resetdefaults button will reset these parameters to the system default values.

3 、 Images

We can see a lot of pictures used in the Zabbix system in the Images page, there are two main types: Icon (icon) and Background (background), these pictures are saved in the database. Icon is mainly used to represent all kinds of monitored devices in the topology diagram, and Background is used to do the background picture of the topology diagram.

According to the type of image you choose, click the Create icon button or Createbackground button in the upper right corner of the page to select the picture to be uploaded. After setting the name of the picture in the Name field, click the Add button to add the image to the system, as shown in figure 2-39 below:

Figure 2-39

Zabbix sets the size of the uploaded image to no more than 1MB through the parameter ZBX_MAX_IMAGE_SIZE. When we use MySQL as the background database and max_allowed_packe is set to 1MB, the upload image size may fail when the image size is close to 1MB. In this case, you need to set the value of max_allowed_packet parameter in MySQL to a higher value.

4 、 Icon Mapping

We can create the icon mapping of the host from the asset record information of the host, and then use it in the topology diagram. When the asset records of a host match the set icon mapping relationship, the set icon is automatically displayed in the topology diagram.

As shown in figure 2-40 below, we define the icon mappings for server, firewall, and router respectively through the Type attribute in the asset record.

Figure 2-40

When making a topology diagram, if the Type attribute of the added host in its asset record is server, then the host will be automatically displayed as the icon set in the icon map when the host is added to the topology diagram.

5 、 Regular expressions

Zabbix supports regular expressions, and there are two ways to use them: manually fill in or reference global regular expressions where they are supported.

So where do regular expressions are supported? It is mainly used in Filter when setting discovery rules in the host or template, as shown in figure 2-41 below.

Figure 2-41

Refer to the global regular expression as shown in figure 2-42 below.

Figure 2-42

We can manage and configure global regular expressions on the Regular expressions page. Click the New regular expression button in the upper right corner of the page to create a new regular expression, as shown in figure 2-43 below.

Figure 2-43

When creating a custom regular expression, we should pay attention to whether the regular expression returns TRUE or FALSE in Zabbix. The name of the regular expression in figure 2-43 is Network interfaces for discovery,Expressions with two regular expressions set, ^ lo$ and ^ Software Loopback Interface,EXPRESSION TYPE (expression type) are both Resultis FALSE. At this point, we can click the Test tag to test. This is shown in figure 2-44 below.

Figure 2-44

Enter the test string eth0 in the Test string in figure 2-44, and click the Testexpressions button to see that the test result is TRUE. Why? First, the eth0 does not match the regular expression, the result is FALSE, and the EXPRESSION TYPE we set is Result is FALSE, so the return result is true. Finally, the and operation is performed on the results of multiple regular expressions to get the return value, namely Combined result.

The main types of EXPRESSION TYPE are as follows:

The string in Character string included:Expression is no longer treated as a regular expression, but is compared as a string to a given string, returning TRUE if the given string contains a string in Expression, otherwise FALSE.

Any character string included: when using this type, you need to set the Delimiter (delimiter). When a given string contains the specified delimiter, the system splits the given string into multiple strings. Any string that contains the string set in Expression returns TRUE, otherwise it returns FALSE.

Character string not included: returns TRUE if the given string does not contain the string set in Expression, otherwise returns FALSE.

Result is TRUE: returns TRUE when a given string matches a regular expression.

Result is FALSE: returns TRUE when the given string does not match the regular expression.

6 、 Macros

Macros (macro variables) in Zabbix can be created in hosts and templates, or global macro variables can be created in Macros pages. When defining a macro variable, you must follow the specified format: {$macro}. The name can be specified by Amurz ZMagi 0-9 Magi _ and. Composition.

The procedure for Zabbix parsing to deal with macro variables is as follows: first check whether the macro variable is set on the host, and if so, use it directly. If no macro variable is found in the host, check to see if the macro variable is set in all templates linked to the host, and if it is used directly. If no macro variable is found in the template, check to see if the global macro variable is set, and if so, use it directly. This is shown in figure 2-45 below.

Figure 2-45

Setting the global macro variable is simple, as shown in figure 2-46 below.

Figure 2-46

7 、 Value mapping

The Value mapping page allows you to create and manage value mappings, through which we can more intuitively understand the status values returned by monitoring items. For example, we define the state value mapping of switch ports: 0-> DOWN and 1-- > UP. This is shown in figure 2-47 below.

Figure 2-47

Then when you define the monitoring entry for the status of the switch port, use the value mapping set in the previous figure in the show value field, as shown in figure 2-48 below.

Figure 2-48

When you check the status of the switch port in the Monitoring-> Latest data page, you will see that the status of the switch port is DOWN or UP, not 0 or 1.

8 、 Working time

The Working time page is used to define working time, which is a system-wide parameter. Working hours are defined as Monday to Friday, 9:00 to 18: 00:00, as shown in figure 2-49 below.

Figure 2-49

The definition of working time must follow the following format: dmurdmai hhpurmm MushRose mm. Where dmurd means from what day to what day, for example, set it to 1-7, that is, from Monday to Sunday. Hh:mm-hh:mm means from what time to a few minutes, where hh is a 24-hour system, can be set to 00 to 24 minutes mm is minutes, can be set to 00 to 59.

You can also define multiple sets of times at the same time, separated by; (semicolon). For example, 1-5 recorder 09laz00-18hand6-7j09lav 00-12:00, which means 9:00 to 18:00 from Monday to Friday, 9:00 to 12:00 on Saturday and Sunday.

According to the defined working time, different background colors are displayed in the graph, the working time background color is white, and the non-working time background color is gray. When we look at the graph, we can tell whether the fault occurred during working hours or non-working hours by the background color, as shown in figure 2-50 below.

Figure 2-50

9 、 Trigger severities

Here we can customize the alarm level of the trigger, including the name and color. It is recommended that you do not change the name of the alarm level on this page, otherwise you need to modify the translation in each language file at the same time. The default alarm level in Zabbix is shown in figure 2-51.

Figure 2-51

10 、 Trigger displaying options

On the Triggerdisplaying options page, you can configure some parameters related to the trigger status display, define the color of the acknowledged/unacknowledgedevents and the blinking option (whether to flash or not), and the time when the state of the trigger and the trigger changes when the display status is OK. This is shown in figure 2-52 below.

Figure 2-52

11 、 Other configuration parameters

Put together some parameters that are not easy to categorize on the Other configuration parameters page, as shown in figure 2-53 below.

Figure 2-53

The meaning of the parameters on the page is as follows:

Refresh unsupported items (insec): sometimes some monitoring items are misconfigured in userparameters or cannot be supported by agent and become unsupported status, but Zabbix will periodically change the status of monitoring items from unsupported to active according to the refresh time set here. The unit is seconds, which can be set to any number. If the monitoring item is set to 0Query unsupported status, it will not become active.

Group for discovered hosts: hosts added by network discovery and agent auto-registration automatically belong to the host group set here.

Default host inventory mode: the default mode of the Host Inventory (host asset record) when creating a new host or Host prototype (host prototype). If Host Inventory is set when creating a new host, this default value will be overridden. Can be set here to disable, manual configuration and automatic configuration.

User group for database downmessage: send an alarm message to the selected user group when there is a problem with the database. If None is selected, it will not be sent. Zabbix uses a specific process Database watchdog to monitor the database. When there is a problem with the database, watchdog will send an alarm notification to the user group. The Zabbix server will not stop working, it will wait until the database returns to normal.

When the SNMP traps received by Log unmatched SNMP traps:Zabbix does not match the configuration of any of the monitoring items, it is recorded in the log.

2.2.5.2 Proxies

When deploying a Zabbix distributed architecture, you need to add a Proxy server through the Proxies page. You can create and manage Proxy on this page. Click the Create proxy button in the upper right corner of the page to create a new Proxyserver, or you can select one or more Proxy, click the Enable Hosts button at the bottom left to enable Proxy;, click the Disable Hosts button to disable Proxy;, click the Delete button to delete Proxy. The Proxies page is shown in figure 2-54 below.

Figure 2-54

The meaning of the page list is as follows:

The name of the u Name:Proxy server.

The working mode of u Mode:Proxy server, Active (active) or Passive (passive).

U Encryption: the status of the connection link encryption. None indicates that there is no encryption, PSK indicates that the shared key is used, and Cert indicates the use of certificate encryption.

U Last seen (age): the time of last communication with the Zabbix server.

U Host count: the number of hosts monitored through the Proxy server.

U Item count: the number of monitoring items monitored through the Proxy server.

U Required performance (vps): query performance of the Proxy server.

U Hosts: a list of all hosts monitored by the Proxy server. Clicking on the host name will open the configuration page for that host.

2.2.5.3 Authentication

There are three main user authentication methods in Zabbix: internal, LDAP and HTTP authentication. The system uses internal authentication by default.

HTTP authentication is based on the identity authentication of Apache Web server. When using this method, the user must already exist in the Zabbix system, but the user password is no longer used.

LDAP authentication is also commonly used and is usually integrated with the company's internal LDAP (supporting Microsoft Active Directory and OpenLDAP) systems to detect the legitimacy of users. Before using LDAP authentication, you need to confirm that the user already exists in the Zabbix system, but the user password is no longer used. The configuration interface is shown in figure 2-55 below.

Figure 2-55

Address of the LDAP host:LDAP server. For example, ldap://ldap.zabbix.com or ldaps://ldap.zabbix.com,ldaps is similar to https, meaning secure ldap connections.

The port of the Port:LDAP server, which defaults to 389, and the port used for secure LDAP connections is 636.

Base DN: benchmark DN (Distinguished Name), which refers to the starting DN of the LDAP search, that is, under which DN to start the search. Such as ou=Users,ou=system (in OpenLDAP) or DC=company,DC=com (in Microsoft ActiveDirectory).

The attributes used in Search attribute:LDAP searches, such as uid in OpenLDAP and sAMAccountName in Microsoft ActiveDirectory.

Bind DN: bind DN to specify a user account that can search for LDAP account permissions on the LDAP server. Such as uid=ldap_search,ou=system (in OpenLDAP) or CN=ldap_search,OU=user_group,DC=company,DC=com (in Microsoft Active Directory).

The password of the specified user in Bind password:Bind DN.

Login: the name of the user who is currently logged in to the Zabbix front-end page. You need to confirm that this user has been added to LDAP, and if the user cannot pass LDAP authentication, Zabbix will not activate LDAP authentication.

User password: user password.

2.2.5.4 User groups

Use the User groups page to complete the creation and management of user groups. Click the Create user group button in the upper right corner of the page to create a new user group, or select one or more user groups, click the Enable button at the lower left to enable the selected user group, click the Disable button to disable the selected user group, click the Enable debug mode button to enable debug mode, click the Disable debug mode button to disable debug mode, and click the Delete button to delete the selected user group. This is shown in figure 2-56 below.

Figure 2-56

The User groups page list has the following meaning:

Name: the name of the user group. Click the user group name to enter the configuration page of the user group.

#: the number of users belonging to the user group. Clicking the Users link will open the list of users for that user group.

Members: displays the user name that belongs to the user group and displays the user's last name and first name in parentheses. Clicking the user name will open the user's configuration page. The disabled user names that belong to this user group are displayed in red.

Frontend access: displays the authentication method for front-end access. System default means that the system default authentication method is used, depending on the authentication method set in Administration-- > Authentication, and can be authenticated using Zabbix, LDAP, or HTTP. Internal means that only Zabbix is used to authenticate users, regardless of which authentication method is set in the system. Disabled forbids the user from accessing the front end.

Debug mode: displays the status of the Debug mode, Enabled or Disabled, click to change the status.

Status: displays the status of the user group, Enabled or Disabled, click to change the status.

2.2.5.5 Users

User creation and management can be done using the Users page. Click the Createuser button in the upper right corner of the page to create a new user or select one or more users, click the Unblock button at the lower left to allow users with a login status of Blocked to revisit the front page, and click the Delete button to delete the selected user. The Users page is shown in figure 2-57 below.

Figure 2-57

The meaning of the page list is as follows:

Alias: the alias of the user, which is used to log in to the Zabbix front-end page.

Name: the user's first name.

Surname: the user's last name.

User type: the type of user. It can be Zabbix Super Admin, Zabbix Admin, or Zabbix User.

Groups: the user group to which the user belongs. Click the user group name to open the configuration page for that user group, and the disabled user group name is displayed in red.

Is online: displays the user's online status (Yes or No) and shows when the user was last logged in in parentheses.

Login: displays the login status of the user (Ok or Blocked). When a user fails to log in more than 5 times in a row, the system temporarily prevents the user from logging in and sets the user's login status to Blocked. Click Blocked to unblock the user.

Frontend access: displays the front-end page access level. The settings of Frontend access in the user group that depend on the user's ownership are Systemdefault, Internal and Disabled, respectively.

Debug: displays the status of the Debug mode. Depending on the setting of the Debugmode option in the user group to which the user belongs, it can be Enabled or Disabled.

Status: displays the status of the user. Depending on the setting of the Enabled option in the user group to which the user belongs, it can be Enabled or Disabled.

2.2.5.6 Media types

The alarm mode can be created and managed through the Media types page. Click the Create media type button in the upper right corner of the page to create an alarm method, or select one or more alarm methods. Click the Enable button at the lower left to enable the selected alarm method, click the Disable button to disable the selected alarm method, and click the Delete button to delete the selected alarm method. The page is shown in figure 2-58 below.

Figure 2-58

The meaning of the page list is as follows:

Name: name of the alarm method. Clicking the name will open the configuration page of the alarm method.

Type: displays the type of transmission media used in the alarm method. Such as e-mail, text messages, etc.

Status: displays the status of the alarm method. Enabled or Disabled, click to change the status.

Used in actions: displays the name of the action that uses this alarm method. Clicking on the action name will open the action's configuration page.

Details: displays the details of the alarm method.

2.2.5.7 Scripts

In Zabbix, we can develop some scripts to expand the function of the system, and we can create and manage scripts in the Scripts page. Click the Create script button in the upper-right corner of the page to create a script, or you can select one or more scripts, and click the Delete button at the lower left to delete the script. The page is shown in figure 2-59 below.

Figure 2-59

The Scripts page list has the following meaning:

Name: the name of the script. Clicking on the script name will open the configuration page of the script.

Type: displays the type of script. Script or IPMI command.

Execute on: shows that the script is executed on Zabbix server or agent.

Commands: displays all commands run in the script.

User group: displays the names of user groups that can use the script.

Host group: displays the name of the host group that can use this script.

Host access: displays the permissions of the host group. Read or Write, only users with the required permissions can execute the script.

Once the script is defined, click on the host name that appears in the Dashboard, Latest data, Status of triggers, Events, and Maps pages, click the script name in the pop-up menu, and the result of the script execution will be displayed in a new browser page. The script can be executed on either Zabbix server or agent.

The menu that pops up after clicking the host name zabbix server on the Events page, as shown in figure 2-60 below.

Figure 2-60

Click the Createscript button in the upper right corner of the Scripts page, fill in the name of the script, the commands you need to execute, and so on, and then click the Add button to save the created script. The configuration page is shown in figure 2-61 below.

Figure 2-61

The meaning of the configuration page parameters is as follows:

Name: the name of the script. Here you can define not only the script name, but also the directory hierarchy displayed in the menu, such as Tools/testscript or Tools/Tools/testscript multi-level directories. The name contains "/" or "\" and must be escaped with a backslash\, for example:\ or\ /. The script calls as shown in figure 2-62 below.

Figure 2-62

Type: the type of script. It can be IPMI or Script.

Execute on: choose where the script is executed, either Zabbix server or Zabbix agent. If you choose to execute the script on agent, you need to set EnableRemoteCommands to 1 in the agent configuration file.

Commands: the command executed in the script. These commands must be full-path, such as: / usr/bin/nmap. Macro variables can be used in commands, including: {HOST.CONN}, {HOST.IP}, {HOST.DNS}, {HOST.HOST}, {HOST.NAME}, and user-defined macro variables. To prevent spaces (such as Host name) in the values of macro variables, you need to enclose them in quotation marks.

Command: the IPMI command to be executed if the script type is IPMI.

Description: the description of the script.

User group: select the user group that can execute the script, and All refers to all user groups.

Host group: select the host group that can execute the script, and All refers to all host groups.

Required host permissions: select the permissions of the host group. Read or Write. Only users with the appropriate permission level can execute the script.

Enable confirmation: when checked, a confirmation window will pop up before the script is executed, and the script will be executed only after you confirm it, to prevent the inadvertent execution of some dangerous script commands.

Confirmation text: confirm the prompt content in the window, which can include {HOST.CONN}, {HOST.IP}, {HOST.DNS}, {HOST.HOST}, {HOST.NAME} and user-defined macro variables.

When evaluating Zabbix performance, a very important method is to view the data displayed on this page. If there is no data in the queue, the performance of the Zabbix system is very good. If there is a lot of data accumulated in the queue, it means that the Zabbix performance has encountered a bottleneck and cannot process the data in the queue in time, so you need to tune the Zabbix server.

By selecting the drop-down box in the upper right corner, you can display the data in the queue from the Overview, Overview by proxy, and Details views. This is shown in figure 2-63 below.

Figure 2-63

2.6 Global search

In the upper right corner of the Zabbix front-end page, there is a search box for global search. When you enter content in the search box, Zabbix will automatically complete according to the host name of the Host. Figure 2-64 below shows.

Figure 2-64

Here, you can search by hostname, IP address, DNS, template name and host group name. The search results show the contents of the host, host group and template respectively. According to the user rights, the hosts, host groups or templates that are allowed to operate are shown in blue, and those that prohibit operation are shown in red. As shown in figure 2-65 below

Figure 2-65

2.7 User Profile

Click the icon in the upper right corner of the Zabbix front-end page to enter the User Profile (user configuration) page. This page is mainly used to configure the password, language and theme style of the currently logged-in user, as well as the alarm method used by the user and the display of alarm information on the front-end page. Changes to these parameters affect only the current user. The configuration page is shown in figure 2-66 below.

Figure 2-66

Each configuration in the User tag means as follows:

Password: click the Change password button to set the new password.

Language: select the language of the front-end page.

Theme: select the theme style of the front page.

Auto-login: automatically log in when checked, without the need to enter a user name and password.

Auto-logout (min 90 seconds): when checked, the logged-in user will automatically log out if there is no action within the specified time. If the user logs in to the system with Remember me for 30 days checked, even if you set the automatic logout option, it will not take effect.

Refresh (in seconds): the time when pages other than Dashboard are automatically refreshed under the Monitoring menu of the front page.

Rows per page: the number of rows displayed in the list of pages, the smaller the number, the faster the page loads.

URL (after login): you can set a specific URL to which the user automatically jumps when logging in. The default URL of the system is Monitoring-> Dashboard.

You can configure how users receive alarms in the Media tag, and here we can configure email, SMS, Wechat and other methods. You can configure how to add multiple alarms. The page is shown in figure 2-67 below.

Figure 2-67

Click the Add link in the Media box, and in the pop-up page, you can configure the type of alarm method, the recipient, the time to receive the alarm, and so on. After the configuration is completed, click the Add button to add the alarm method. This is shown in figure 2-68 below.

Figure 2-68

Zabbix supports displaying alarm messages in front-end pages, which is called Globalnotification. When a problem occurs, a prompt is issued in the upper-right corner of any page on the front end. The configuration for displaying alarm information is set in the Messaging tab, as shown in figure 2-69 below.

Figure 2-69

Each configuration in the Messaging tag means as follows:

Frontend messaging: enable Global notification when checked.

Message timeout (seconds): the time for the alarm message to be displayed on the screen is 60 seconds by default.

Play sound: the playback of alarm sound files. Once is played only once, 10 seconds is repeated for 10 seconds, and Message timeout is repeated until the alarm message is browsed or the time defined in Message timeout (seconds) is reached.

Trigger severity: set which alarm level Trigger can alarm in the frontend page, and whether to enable alarm sound.

Other configuration parameters

Most of the parameters in Zabbix can be configured in the web page, but there are some parameters that can only be configured by editing the program file written by php, which is defines.inc.php in the include directory under the root directory of the Zabbixweb program (Zabbix 3.0.1 is installed in / usr/share/zabbix by default). The main configuration parameters are:

ZBX_LOGIN_ATTEMPTS: the default value is 5, the number of times a user using internal authentication can try to log in when he or she cannot log in normally. When the number of times is exceeded, the system locks the account and forbids login.

ZBX_LOGIN_BLOCK: the default value is 30 seconds, and how long it takes for an account whose login number is locked to log in to the system again.

ZBX_PERIOD_DEFAULT: the default value is 1 hour, and the time span shown in the drawing is in seconds.

ZBX_MIN_PERIOD: the default value is 1 hour, and the shortest time span, in seconds, is displayed in the drawing.

ZBX_MAX_PERIOD: the default value is 2 years, and the longest time span in seconds is displayed in the drawing.

ZBX_HISTORY_PERIOD: the default value is 24 hours, and the maximum time span (in seconds) for displaying historical data in the Latest data page. There is no time span limit when set to 0.

GRAPH_YAXIS_SIDE_DEFAULT: the default value is 0, the position of the Y axis in the drawing, 0 for the left and 1 for the right.

DEFAULT_LATEST_ISSUES_CNT: the default value is 20 how many issues are displayed in the Last n issues information window in the Dashboard.

SCREEN_REFRESH_TIMEOUT: the default is 30 seconds. When the element (element) in the display page refreshes the data, if the request times out, the relevant element area on the display page will be dimmed. This is the timeout. In seconds.

SCREEN_REFRESH_RESPONSIVENESS: the default value is 10 seconds. When element refreshes data on the display screen, requests are queued in order. If a request times out, subsequent requests are blocked. To avoid this situation, the timeout period (in seconds) is set for each request through this parameter.

2.8 Front-end maintenance mode

When the Zabbix front-end Web page needs to be maintained, in order to prevent data inconsistency caused by user operations and ensure the integrity of the database, users can be temporarily prohibited from accessing the Zabbix front-end page. A message that the Zabbix system is maintaining appears when the user visits the front-end page. This is shown in figure 2-70 below.

Figure 2-70

To enable front-end maintenance mode, we need to edit the program file maintenance.inc.php written by php, which is located in the / etc/zabbix/web directory (Zabbix 3.0.1 is installed by default).

# cat / etc/zabbix/web/maintenance.inc.php

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Servers

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report