Estimation of Individual Micro Data from Aggregated Open Data

12/19/2017
by   Han-mook Yoo, et al.
0

In this paper, we propose a method of estimating individual micro data from aggregated open data based on semi-supervised learning and conditional probability. Firstly, the proposed method collects aggregated open data and support data, which are related to the individual micro data to be estimated. Then, we perform the locality sensitive hashing (LSH) algorithm to find a subset of the support data that is similar to the aggregated open data and then classify them by using the Ensemble classification model, which is learned by semi-supervised learning. Finally, we use conditional probability to estimate the individual micro data by finding the most suitable record for the probability distribution of the individual micro data among the classification results. To evaluate the performance of the proposed method, we estimated the individual building data where the fire occurred using the aggregated fire open data. According to the experimental results, the micro data estimation performance of the proposed method is 59.41

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/06/2019

Iterative Self-Learning: Semi-Supervised Improvement to Dataset Volumes and Model Accuracy

A novel semi-supervised learning technique is introduced based on a simp...
research
01/11/2020

Bayesian Semi-supervised learning under nonparanormality

Semi-supervised learning is a classification method which makes use of b...
research
08/01/2020

Extracting actionable information from microtexts

Microblogs such as Twitter represent a powerful source of information. P...
research
11/06/2021

Order-Guided Disentangled Representation Learning for Ulcerative Colitis Classification with Limited Labels

Ulcerative colitis (UC) classification, which is an important task for e...
research
02/20/2020

APTER: Aggregated Prognosis Through Exponential Reweighting

This paper considers the task of learning how to make a prognosis of a p...
research
05/10/2019

Credit Scoring for Micro-Loans

Credit Scores are ubiquitous and instrumental for loan providers and reg...

Please sign up or login with your details

Forgot password? Click here to reset