Multitenant Approach to Crawling of Online Social Networks

The importance of online social networks (OSN) and their data leads to the need to collect this data for different purposes. Restrictions imposed by various OSNs prevents obtaining this data in the required volume and time. Sharing credentials by many users in combination with different user needs and their request types can solve this problem, but in its own turn requires a new approach to organize such sharing efficiently and fairly among users. One of the most critical characteristics is throughput. In order for throughput to be fairly provided to users, sophisticated load balancing methods in addition to crawler architecture that has to manage multiple credentials and users must be developed. This work proposes a new approach that deals with the aforementioned issues and can improve characteristics of throughput for multiple users.