手机版

c ○ 2001 Kluwer Academic Publishers. Manufactured in The Ne(3)

发布时间:2021-06-07   来源:未知    
字号:

Abstract. A data cube is a popular organization for summary data. A cube is simply a multidimensional structure that contains in each cell an aggregate value, i.e., the result of applying an aggregate function to an underlying relation. In practical situat

LOGLINEAR-BASEDQUASICUBES257densechunksofthecorecuboidinthedatacube.Thesemodels,canbeusedtoestimatecells,withacertaindegreeofaccuracy.Wekeeptheerrorscausedbytheestimationprocessundercontrolbystoring,alongwiththemodelparameters,thosecellswhoseestimatedvaluesdifferfromtherealvaluesbymorethanapre-establishedthreshold.Thisideamaintainsa xedboundforqueriesoverthecorecuboid,providingguaranteesfortheapproximatedanswers.Moreover,theideacanbeeasilyextendedtoanyothercuboid(withouthavingtorecomputemodelsforanyofthesecuboids):bymaintainingasmallnumberofcellsineachlevelofaggregation,orcuboid,wecanhaveguaranteedboundsforapproximateanswersovertheentiredatacube.This,isanalternativetotechniquesthatdecidewhichpartsofthecubeshouldbematerializedtoobtainagoodtradeoffbetweenspaceandqueryperformance,suchastheheuristicspresentedinHarinarayanetal.(1996).Inourcase,withaverysmallinvestment(afewofthecuboids’cells)wecanprovideapproximateanswersforqueriesposedoverallthedatacube.Moreover,withcoarseraggregations(cuboidswithlessdimensions,suchasday,productinthelatticeof gure1),wecanguaranteetighterboundsfortheanswers,simplybecausetheerrorscommittedbytheestimationofindividualcellstendtocanceleachother.

WecallthestructurethatresultsfromstoringthemodelsandtheretainedcellsaQuasi-Cube.Itisimportanttoemphasizethat,inaQuasi-Cube,theerrorboundcanbekeptatadesiredlevel,independentlyofthedistributionofthedata.Whenansweringqueries,thesystemcanusethemodelsandtheretainedcellstogiveananswerwithaguaranteedmaximumerrorlevelattachedtoit.

Parametricmethodstocompressdatacubeshaveanadvantageoverothertechniques(suchastheonesdescribedinPoosalaetal.(1996)andVitterandWang(1999)):theparameterscomputeddescribethedataaccuratelyandcanserveasagoodbasistomineimportantconclusionsabouttheunderlyingdistributionofdata.Thestructureofthemodeldescribesthepatternsofinteraction(Agresti,1996).Moreover,onecanimmediatelyknowwhichdimension(orcombinationsofdimensions)exertthebiggestin uenceinthedatabylookingattherelativesizeofthemodelparameters(Agresti,1996).Bycomparison,itisdif culttodrawinformationfromahistogram(asusedinPoosalaetal.(1996))orawaveletdecomposition(asusedinVitterandWang(1999)).AlthoughtheapproachusedinShanmugasundarametal.(1999)offerssimilaradvantagestoourtechniquebyobtainingakernelthatexplainsthedistributionofthedata,itiswell-knownthatkernelestimationsareveryinef cientasthenumberofdimensionsgrow(Silverman,1994).Thisistruebecausetruncatingthetailsofthedistributionscanhaveanenormouseffectontheerrorsobtained.(Inotherwords,inmoderate-tohigh-dimensionalcases,regionsofrelativelowdensitycanstillbeveryimportantpartsofthedistribution.)Incontrast,itisknownthatanydistributioncanbeapproximatedarbitrarilyclosebyaparametricmodelbyusingenoughparameters(CherkasskyandMulier,1998).Infact,themodelwithwithtoomanyparametersisnotveryinformativetoend-users.Howtochoosetheconciseyetprecisemodelisonemotivationofourwork.Moreover,inShanmugasundarametal.(1999),theauthorsdecidetoretainonlythe“outliers”that tinamemorybuffer,makingtheaccuracyofthemethoddependonthedata,ratherthanonthemethoditself.

Itisalsoimportanttostressthattheprovidingcompressionofthewholedatacube,whileguaranteeingerrorboundsforeveryquery,regardlessoftheaggregationisnotaneasytask

c ○ 2001 Kluwer Academic Publishers. Manufactured in The Ne(3).doc 将本文的Word文档下载到电脑,方便复制、编辑、收藏和打印
×
二维码
× 游客快捷下载通道(下载后可以自由复制和排版)
VIP包月下载
特价:29 元/月 原价:99元
低至 0.3 元/份 每月下载150
全站内容免费自由复制
VIP包月下载
特价:29 元/月 原价:99元
低至 0.3 元/份 每月下载150
全站内容免费自由复制
注:下载文档有可能出现无法下载或内容有问题,请联系客服协助您处理。
× 常见问题(客服时间:周一到周五 9:30-18:00)