Shulou(Shulou.com)05/31 Report--

This article mainly introduces what GitMonitor is, has a certain reference value, interested friends can refer to, I hope you can learn a lot after reading this article, the following let the editor take you to understand it.

GitMonitor

GitMonitor is a scanning system for GitHub, with its help, researchers can easily scan the sensitive information in the target GitHub library.

The tool implements its function based on rules, and GitMonitor uses two different sets of rules to find target information. Search rules will search the target code base and look for information related to the organization or internal projects, while sensitive filtering rules will determine whether there is sensitive information in the target code base. Finally, the tool will send the scan report to the user through Slack. You can also use GitMonitor with Cronjob to monitor the target and track sensitive information leaked in GitHub, and finally receive the scan results through Slack.

Function introduction

1. Search the target code base based on rules (search rules). You can also write custom rules to search the code base related to your organization or enterprise, and the code base that matches the rules will be cloned directly to the local.

2. Use regular expressions (sensitive filtering rules) to search for sensitive information that has been cloned to the local code base and classify it.

3. Send scan report through Slack.

4. Rules and regular expressions are defined separately.

5. Users can easily customize rules and regular expressions.

Tool operation mechanism

Tool requirements

Python3

Python3-pip

At present, the tool has been tested on Ubuntu 18.04system.

Tool installation

First, clone the project source code locally using the following command:

Git clone https://github.com/Talkaboutcybersecurity/GitMonitor.git installation dependent component: Python3-m pip install-r requirements.txt

Make sure you have Pyyaml v5x or later installed on your device.

Next, fill in the required information in the configuration file config.ini:

[git]

User =

Pass =

Url_code = https://api.github.com/search/code?q={}+in:file&sort=indexed&order=desc

Url_repos = https://api.github.com/search/repositories?q={}+size:>0+is:public&sort=indexed&order=desc

Url_commit = https://api.github.com/search/commits?q={}+is:public&sort=indexed&order=desc

Rpp = 50

[slack]

Webhooks =

[path]

Rule =

Source =

Log =

[msg]

Start = = *

* Start scanning at {} *

_ Clone completed successfully:_

End = = *

* Scanning Done at {} *

_ Detected possible repository:_

All = = *

Write custom search rules and put them in the rule dictionary:

Id: Project_X_Matching

Key: X

Language:

-java

# filename:

#-LICENSE

# extension:

#-py

#-md

Ignore:

# language:

#-php

Filename:

-LICENSE

Extension:

-html

-txt

Next, define the regular expression in the sensitive filter rules file libs/regex.py and run the following command:

Python3 gitmonitor.py

You can also use Cronjob to automate GitMonitor (scheduled tasks).

Thank you for reading this article carefully. I hope the article "what is GitMonitor" shared by the editor will be helpful to you. At the same time, I also hope you will support us and pay attention to the industry information channel. More related knowledge is waiting for you to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.