Development of Deep Neural Networks Framework for Travel User Interest Discovery from Visual Shared Data in Social Networks (Case Study Facebook, Sudan)

Abstract

Social networks are virtual environments where users express their opinions, preferences and interests. All shared information in Social Networks like Facebook, Twitter, LinkedIn can be very useful to understand citizen’s interest. This study aims to discover the travel user’s interests through the shared social images. The most proposed works depend a lot on textual data to analyse social networks and avoid the visual data especially in Facebook, due to the lack or the limitation of available social images analysis systems. Our proposed system is a novel framework to detect travel user’s interests from their posted and shared images in Facebook network. The two research questions are (1) what the current models of image analysis are used to discover the user’s interests in social networks especially in Facebook, and (2), how may those models be improved or select the best of them to discover the user’s interests. In terms of methods, deep neural network approaches were used. First we proposed a comparison between approaches based on Feedforward learning of Convolutional Neural Network (CNN) architectures GoogleNet and VGG’19 trained on Places365 Dataset for visual object Recognition. Once objects are recognized in images, we proposed a Deep Ontology Travel User Interest System (DOTUIS) based decision system for travel users interest prediction, our approaches based on CNN, GoogleNet and VGG’19 architectures can facilitate the interest of travel topic make it easy to discover is the users interest in travel or not, the GoogleNet architecture leading to a better performance and improving the classification accuracy than VGG’19 and in order to evaluate our Deep Neural approach, we have constructed a new database of shared images in Sudanese and Tunisian Facebook accounts. Our approaches have shown a promising result on Sudanese Facebook accounts database. Second, we proposed Deep Fuzzy Ontology Travel User Interest System (DFOTUIS) based on CNN, GoogleNet and VGG’19 architectures, and our proposed system has shown a very impressive result for travel Sudanese user’s interest. Both proposed ontologies are tested and evaluated on collected Sudanese Database. The Deep fuzzy ontology system (DFOTUIS) performs well than the crisp inference system (DOTUIS). Based on the profile outputted from the deep fuzzy ontology we proposed an Intelligent Recommendation System for Travellers’ Preferences (IRSTP).