PDA

View Full Version : Data mining



trinitree88
2011-Sep-14, 06:03 PM
Like it or not, the exponential growth of data from advanced satellite technology, is going to require algorithms to extract the information in usable form, and additional methods to do so efficiently. A new field is developing here. SEE:http://arxiv.org/abs/1109.2840

Kullat Nunu
2011-Sep-14, 08:25 PM
Isn't the data that will/is being produced by synoptic surveys such as Pan-STARRs and LSST much more than what satellites can produce.

trinitree88
2011-Sep-14, 08:32 PM
Isn't the data that will/is being produced by synoptic surveys such as Pan-STARRs and LSST much more than what satellites can produce.
kullat. Yep, I didn't mean to exclude ground based tech. pete

loglo
2011-Sep-15, 02:38 AM
This looks like a promising approach:-
SciBORQ: Scientific data management with Bounds On Runtime and Quality (http://www.cidrdb.org/cidr2011/Papers/CIDR11_Paper39.pdf) (6 page PDF)

"We propose SciBORQ, a framework for scientific data exploration that gives precise control over runtime and quality of query answering. We present novel techniques to derive multiple interesting data samples, called impressions. An impression is selected such that the statistical error of a query answer remains low, while the result can be computed within strict time bounds. Impressions differ from previous sampling approaches in their bias towards the focal point of the scientific data exploration, their multi-layer design, and their adaptiveness to shifting query workloads. The ultimate goal is a complete system for scientific data exploration and discovery, capable of producing quality answers with strict error bounds in pre-defined time frame."