A Complex Mining Process about Air Quality

Abstract : In this paper we present a mining project about extracting knowledge from public documents concerning air pollution. Our collection contains annual reports about air quality, acid rains, climatological conditions in the large area of Mexico City. These reports contain reliable data and are generated by the Department of Environment, they are in a printable format (.pdf file) with number of pages, table of content, textual information, numerical information in tables, images. For a human being it is impossible to read the whole collection during a relatively short period (a few days or weeks) and understand the content of them. An automatic box of tools able to extract knowledge, to quick retrieve important term, to answer some exact questions about precise climate parameters would be an important help for lecturers. We will describe our project based upon a text and data mining process; the aims of the complex process are extract frequent temporal pattern, to extract association rules, to integrate also some information retrieval simple tools. In parallel, some data mining techniques will be used to detect the same types of data presented in every report and then to extract a numerical datamart containing climatological data structured by month, year, geographical area. The datamart will be analyzed also. The main steps of our mining process are: preparing documents (cleaning, removing images, table of contents, footnotes), transforming in structured document (in a XML format with a precise DTD), indexing, various algorithms and methods of mining, visualising results and validating knowledge. We think also that our methodology will concern also other collections of the same category : reliable data and informations presented in huge periodical reports.
Document type :
Conference papers
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal-emse.ccsd.cnrs.fr/emse-00870769
Contributor : Florent Breuil <>
Submitted on : Friday, October 31, 2014 - 10:35:31 AM
Last modification on : Tuesday, October 23, 2018 - 2:36:09 PM
Long-term archiving on : Monday, February 2, 2015 - 4:24:48 PM

File

35_juganaru-mathieu_mihaela.pd...
Files produced by the author(s)

Identifiers

Citation

Mihaela Juganaru-Mathieu, Silvia González Brambila. A Complex Mining Process about Air Quality. Eureka-2013 : fourth international workshop on Knowledge Discovery, Knowledge Management and Decision Support., Nov 2013, Mazatlan, Mexico. pp. 290-294, ⟨10.2991/.2013.35⟩. ⟨emse-00870769⟩

Share

Metrics

Record views

162

Files downloads

570