Improving Performance of DOM in Semi-structured Data Extraction using WEIDJ Model

• DOI: 10.11591/ijeecs.v9.i3.pp752-763
• Publication Date: 2019-01-26T13:38:11Z
• Authors: Ily Amalina Ahmad...; Mustafa Man
• Keywords: FOS: Computer and information sciences; JavaScript; HTML; Information extraction; Web Data Extraction; JSON; MEDLINE; FOS: Political science; JSON (JavaScript Object Notation); Data extraction; Web navigation; FOS: Law; 02 engineering and technology; Database; Web Data Extraction and Crawling Techniques; Page Segmentation; 0202 electrical engineering, electronic engineering, information engineering; Information retrieval; Political science; Document Object Model; Web Crawling; Web service; Semi-structured data; Static web page; Computer science; World Wide Web; Computer Science; Physical Sciences; Ajax; DOM (Document Object Model); Web page; Information Extraction; Law; Information Systems; Web modeling

<p>Web data extraction is the process of extracting user required information from web page. The information consists of semi-structured data not in structured format. The extraction data involves the web documents in html format. Nowadays, most people uses web data extractors because the extraction involve large information which makes the process of manual information extraction takes time and complicated. We present in this paper WEIDJ approach to extract images from the web, whose goal is to harvest images as object from template-based html pages. The WEIDJ (Web Extraction Image using DOM (Document Object Model) and JSON (JavaScript Object Notation)) applies DOM theory in order to build the structure and JSON as environment of programming. The extraction process leverages both the input of web address and the structure of extraction. Then, WEIDJ splits DOM tree into small subtrees and applies searching algorithm by visual blocks for each web page to find images. Our approach focus on three level of extraction; single web page, multiple web page and the whole web page. Extensive experiments on several biodiversity web pages has been done to show the comparison time performance between image extraction using DOM, JSON and WEIDJ for single web page. The experimental results advocate via our model, WEIDJ image extraction can be done fast and effectively.</p>