calculate parallelly

最新推荐文章于 2025-01-23 23:46:20 发布

转载最新推荐文章于 2025-01-23 23:46:20 发布 · 199 阅读

本文探讨了在Essbase中实现并行计算的方法与技巧，包括如何设置CALCPARALLELn参数来分配处理器资源，CALCTASKDIMS参数对于并行任务的影响，以及调整CALCCACHEHIG参数以利用缓存减少任务维度。

usually:

SET CALCPARALLEL n;

where n is one less than the number of processor, so

leave one process for other calcuations.

but set this doesn't mean calculation will run parallely:

FIX ("Actual", "Final", &Cur_Yr)
AGG("Product", "Department", "Location", "Detail", "Channel");
ENDFIX

Years, Scenaro, Version is last 3 sparse dimension, since here

did not set CALCTASKDIMS, so default is use last sparse dimension:

[Wed May 23 14:35:31 2012]EssSvr64/Margin/Main/essadmin/Info(1012678)
Calculating in parallel with [4] threads

[Wed May 23 14:35:31 2012]EssSvr64/Margin/Main/essadmin/Info(1012679)
Calculation task schedule [1]

[Wed May 23 14:35:31 2012]EssSvr64/Margin/Main/essadmin/Info(1012680)
Parallelizing using [1] task dimensions.

[Wed May 23 14:40:16 2012]EssSvr64/Margin/Main/essadmin/Info(1012579)
Total Calc Elapsed Time for [test.csc] : [284.59] seconds

so here task is not paralleled since we fixed in actual->final

now if we

SET CALCTASKDIMS 4;

[Wed May 23 14:41:09 2012]EssSvr64/Margin/Main/essadmin/Info(1012678)
Calculating in parallel with [4] threads

[Wed May 23 14:41:09 2012]EssSvr64/Margin/Main/essadmin/Info(1012679)
Calculation task schedule [1]

[Wed May 23 14:41:09 2012]EssSvr64/Margin/Main/essadmin/Info(1012680)
Parallelizing using [2] task dimensions. Usage of Calculator cache caused reduction in task dimensions

[Wed May 23 14:45:51 2012]EssSvr64/Margin/Main/essadmin/Info(1012579)
Total Calc Elapsed Time for [test.csc] : [282.49] seconds

still, since we fix in actual->final, task is not paralleled.

now let's increase CALCCACHEHIG ( maximum is 200,000,000 bytes), and rebounce the essbase service to make it take effect.

and use:

SET CACHE HIGH;

[Wed May 23 14:49:14 2012]EssSvr64/Margin/Main/essadmin/Info(1012678)
Calculating in parallel with [4] threads

[Wed May 23 14:49:14 2012]EssSvr64/Margin/Main/essadmin/Info(1012679)
Calculation task schedule [133,18,4,1,1,1,1]

[Wed May 23 14:49:14 2012]EssSvr64/Margin/Main/essadmin/Info(1012680)
Parallelizing using [4] task dimensions.

[Wed May 23 14:51:29 2012]EssSvr64/Margin/Main/essadmin/Info(1012681)
Empty tasks [67,6,0,0,0,0,0]

[Wed May 23 14:51:29 2012]EssSvr64/Margin/Main/essadmin/Info(1012579)
Total Calc Elapsed Time for [test.csc] : [134.6] seconds

calculation paralleled in detail dimension.

now if change outline, make location, detail in the last 2 sparse dimension:

[Wed May 23 15:29:23 2012]EssSvr64/Margin/Main/essadmin/Info(1012678)
Calculating in parallel with [4] threads

[Wed May 23 15:29:23 2012]EssSvr64/Margin/Main/essadmin/Info(1012679)
Calculation task schedule [6517,2478,944,302,228,220,88,22,7,3,2,1]

[Wed May 23 15:29:23 2012]EssSvr64/Margin/Main/essadmin/Info(1012680)
Parallelizing using [3] task dimensions. Usage of Calculator cache caused reduction in task dimensions

[Wed May 23 15:29:25 2012]EssSvr64/Margin/Main/essadmin/Info(1012568)
Commit Blocks Interval was adjusted to be [6144] blocks

[Wed May 23 15:31:01 2012]EssSvr64/Margin/Main/essadmin/Info(1012681)
Empty tasks [5187,1662,545,139,102,85,18,2,0,0,0,0]

[Wed May 23 15:31:01 2012]EssSvr64/Margin/Main/essadmin/Info(1012579)
Total Calc Elapsed Time for [test.csc] : [98.8]

this is fastest since calculation parallel in location, detail 2 dimensions.

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/8583032/viewspace-730774/，如需转载，请注明出处，否则将追究法律责任。

转载于:http://blog.itpub.net/8583032/viewspace-730774/