Enhancing Template Extraction accuracy of Heterogenous Web Documents
Main Article Content
Abstract
Countless websites contain large set of pages generated using the common templates with contents. Due to the extraneous terms in templates, they degrade the accuracy and performance of web applications. Thus, template detection techniques have received a lot of attention recently to enhance the performance of web applications such as search engines, clustering, and classification. Thus, in order to prevent the duplication in the templates, nowadays we handle them with some detection techniques. In this paper, we present techniques for automatically cropping clusters based on MDL cost that can be used to extract search result records from dynamically generated web documents. Thus, we don’t need additional template extraction process after clustering. Experimental results show that our proposed approach is feasible and effect for improving extraction accuracy.
Â
Keywords: Minimum Description Length (MDL), template extraction, MinHash, Max Algorithm, dice algorithm, clustering
Downloads
Article Details
COPYRIGHT
Submission of a manuscript implies: that the work described has not been published before, that it is not under consideration for publication elsewhere; that if and when the manuscript is accepted for publication, the authors agree to automatic transfer of the copyright to the publisher.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work
- The journal allows the author(s) to retain publishing rights without restrictions.
- The journal allows the author(s) to hold the copyright without restrictions.