Security Threats Detection Of The Social Blogosphere
Our customer was determined to develop a security service that will be able to analyze third-party websites content such as forums or blogs in order to detect planned hacker attacks and similar illegal actions. As Axmor has extensive experience in Big Data processing, Social Network Mining and Users Opinion Analysis, which interested our client most, Axmor developers were approached to design the security service prototype.
Axmor designed and developed the security service prototype which provides data mining from heterogeneous Internet resources, and user alerts and notifications regarding threats, planned hacker attacks and other illegal actions. The security service has the following modules: web interface for data collection parameters management and analysis, third-parties websites web crawler servers, database repository and potential threat detection notification system. This service is designed for banks and companies to monitor and detect potential threats that can lead to significant business damage.
User profiles management
Service administrators register and set up new user profiles according to the selected tariff plan.
In the personal account, users manage a list of websites for scanning and configures content filtering keyword lists for which they want to receive data. Bank name, bank card number, persons' name and much more can all be used as keywords. Users also specify e-mail addresses to receive prompt notifications of potential threats.
Website Crawling Service
The developed web crawling service scanning third-party websites by emulating user behavior to bypass real-time bots resource protection. In addition, to provide traffic anonymity we use an onion routing distributed network (Tor).
Scan results search
The scanned websites data are stored encrypted in the database repository. We have developed a query builder that creates and saves complex search queries using given keywords list and logical operators. Created queries are utilized to search the scanned data stored in the database. At the same time, the developed solution uses morphology based built in SQL-like search engine. All duplicated data is deleted from the dataset, leaving only the unique data.
Potential threats alerts
Based on the scanned data, users receive e-mail alerts if the developed security service has detected data related to specific keywords.
Users can review data for a selected period of time regarding the number and content of sent alerts.
Axmor integrated the developed security service with Twitter, allowing users to publish received potential threat alerts on their Twitter account. This functionality is especially beneficial for banks, as they can instantly inform their Twitter followers about scammers bank cards numbers.