01764nas a2200241   4500000000100000000000100001008004100002260001200043653001700055653001400072653002000086653001200106653002200118100002200140700001800162700001500180245009600195856008100291300001200372490000600384520111800390022001401508       2021                            d  c06/202110aWeb Crawlers10aSemantics10aWord Embeddings10aAdagrad10aRecurrent Network1 aP. R. Joe Dhanith1 aB. Surendiran1 aS. P. Raja00aA Word Embedding Based Approach for Focused Web Crawling Using the Recurrent Neural Network  uhttps://www.ijimai.org/journal/sites/default/files/2021-05/ijimai_6_6_13.pdf  a122-1320 v63 aLearning-based focused crawlers download relevant uniform resource locators (URLs) from the web for a specific topic. Several studies have used the term frequency-inverse document frequency (TF-IDF) weighted cosine vector as an input feature vector for learning algorithms. TF-IDF-based crawlers calculate the relevance of a web page only if a topic word co-occurs on the said page, failing which it is considered irrelevant. Similarity is not considered even if a synonym of a term co-occurs on a web page. To resolve this challenge, this paper proposes a new methodology that integrates the Adagrad-optimized Skip Gram Negative Sampling (A-SGNS)-based word embedding and the Recurrent Neural Network (RNN).The cosine similarity is calculated from the word embedding matrix to form a feature vector that is given as an input to the RNN to predict the relevance of the website. The performance of the proposed method is evaluated using the harvest rate (hr) and irrelevance ratio (ir). The proposed methodology outperforms existing methodologies with an average harvest rate of 0.42 and irrelevance ratio of 0.58.  a1989-1660