Ignore:
Timestamp:
11/21/12 14:36:42 (12 years ago)
Author:
wojtekp
Message:
 
Location:
papers/SMPaT-2012_DCWoRMS
Files:
5 edited

Legend:

Unmodified
Added
Removed
  • papers/SMPaT-2012_DCWoRMS/elsarticle-DCWoRMS.aux

    r639 r648  
    1111\citation{DCD_Romonet} 
    1212\citation{GSSIM} 
     13\@writefile{toc}{\contentsline {subsection}{\numberline {2.4}Summary}{5}} 
    1314\@writefile{toc}{\contentsline {section}{\numberline {3}DCWoRMS}{5}} 
    1415\citation{GWF} 
     
    1920\newlabel{fig:arch}{{1}{6}} 
    2021\@writefile{toc}{\contentsline {subsection}{\numberline {3.1}Architecture}{6}} 
    21 \@writefile{toc}{\contentsline {subsection}{\numberline {3.2}Workload modeling}{6}} 
     22\@writefile{toc}{\contentsline {subsection}{\numberline {3.2}Workload modeling}{7}} 
    2223\@writefile{toc}{\contentsline {subsection}{\numberline {3.3}Resource modeling}{7}} 
    2324\@writefile{lof}{\contentsline {figure}{\numberline {2}{\ignorespaces  Levels of information about jobs}}{8}} 
     
    2526\citation{GSSIM_Energy} 
    2627\@writefile{toc}{\contentsline {subsection}{\numberline {3.4}Energy management concept in DCWoRMS}{9}} 
    27 \@writefile{toc}{\contentsline {subsubsection}{\numberline {3.4.1}Power management}{9}} 
    28 \@writefile{lof}{\contentsline {figure}{\numberline {3}{\ignorespaces  Energy consumption modeling}}{10}} 
    29 \newlabel{fig:powerModel}{{3}{10}} 
     28\@writefile{toc}{\contentsline {subsubsection}{\numberline {3.4.1}Power management}{10}} 
    3029\@writefile{toc}{\contentsline {paragraph}{\textbf  {Power profile}}{10}} 
    3130\@writefile{toc}{\contentsline {paragraph}{\textbf  {Energy consumption model}}{10}} 
    3231\@writefile{toc}{\contentsline {paragraph}{\textbf  {Power management interface}}{10}} 
     32\@writefile{lof}{\contentsline {figure}{\numberline {3}{\ignorespaces  Energy consumption modeling}}{11}} 
     33\newlabel{fig:powerModel}{{3}{11}} 
    3334\@writefile{toc}{\contentsline {subsubsection}{\numberline {3.4.2}Air throughput management concept}{11}} 
    3435\@writefile{toc}{\contentsline {paragraph}{\textbf  {Air throughput profile}}{11}} 
    3536\@writefile{toc}{\contentsline {paragraph}{\textbf  {Air throughput model}}{11}} 
    36 \@writefile{toc}{\contentsline {paragraph}{\textbf  {Air throughput management interface}}{11}} 
    3737\@writefile{lof}{\contentsline {figure}{\numberline {4}{\ignorespaces  Air throughput modeling}}{12}} 
    3838\newlabel{fig:airModel}{{4}{12}} 
     39\@writefile{toc}{\contentsline {paragraph}{\textbf  {Air throughput management interface}}{12}} 
    3940\@writefile{toc}{\contentsline {subsubsection}{\numberline {3.4.3}Thermal management concept}{12}} 
    4041\@writefile{toc}{\contentsline {paragraph}{\textbf  {Thermal profile}}{12}} 
    4142\@writefile{toc}{\contentsline {paragraph}{\textbf  {Temperature estimation model}}{12}} 
    42 \@writefile{toc}{\contentsline {paragraph}{\textbf  {Thermal resource management interface}}{12}} 
    4343\@writefile{lof}{\contentsline {figure}{\numberline {5}{\ignorespaces  Temperature estimation modeling}}{13}} 
    4444\newlabel{fig:tempModel}{{5}{13}} 
     45\@writefile{toc}{\contentsline {paragraph}{\textbf  {Thermal resource management interface}}{13}} 
    4546\@writefile{toc}{\contentsline {subsection}{\numberline {3.5}Application performance modeling}{13}} 
    4647\@writefile{toc}{\contentsline {section}{\numberline {4}Modelling of energy efficiency in DCWoRMS}{14}} 
    4748\@writefile{toc}{\contentsline {subsection}{\numberline {4.1}Power consumption models}{14}} 
    48 \@writefile{toc}{\contentsline {paragraph}{\textbf  {Static approach}}{14}} 
    49 \@writefile{toc}{\contentsline {paragraph}{\textbf  {Resource load}}{14}} 
    50 \@writefile{toc}{\contentsline {paragraph}{\textbf  {Application specific}}{14}} 
    5149\@writefile{toc}{\contentsline {subsection}{\numberline {4.2}Air throughput models}{15}} 
    52 \@writefile{toc}{\contentsline {paragraph}{\textbf  {Static}}{15}} 
    53 \@writefile{toc}{\contentsline {paragraph}{\textbf  {Space}}{15}} 
    5450\@writefile{toc}{\contentsline {subsection}{\numberline {4.3}Thermal models}{15}} 
    55 \@writefile{toc}{\contentsline {paragraph}{\textbf  {Static}}{15}} 
    56 \@writefile{toc}{\contentsline {paragraph}{\textbf  {Ambient}}{15}} 
     51\@writefile{lot}{\contentsline {table}{\numberline {1}{\ignorespaces CoolEmAll testbed}}{16}} 
    5752\@writefile{toc}{\contentsline {section}{\numberline {5}Experiments and evaluation}{16}} 
    5853\@writefile{toc}{\contentsline {subsection}{\numberline {5.1}Testbed description}{16}} 
    59 \@writefile{toc}{\contentsline {subsection}{\numberline {5.2}Computattional analysis}{16}} 
    60 \@writefile{toc}{\contentsline {section}{\numberline {6}DCWoRMS application}{16}} 
     54\@writefile{toc}{\contentsline {subsection}{\numberline {5.2}Computational analysis}{16}} 
     55\@writefile{toc}{\contentsline {section}{\numberline {6}DCWoRMS application/use cases}{17}} 
    6156\bibcite{CloudSim}{{1}{}{{}}{{}}} 
    6257\bibcite{DCSG}{{2}{}{{}}{{}}} 
    6358\bibcite{DCD_Romonet}{{3}{}{{}}{{}}} 
    6459\bibcite{Ghislain}{{4}{}{{}}{{}}} 
     60\@writefile{toc}{\contentsline {section}{\numberline {7}Conclusions and future work}{18}} 
     61\newlabel{}{{7}{18}} 
    6562\bibcite{GreenCloud}{{5}{}{{}}{{}}} 
    6663\bibcite{GSSIM}{{6}{}{{}}{{}}} 
    6764\bibcite{GSSIM_Energy}{{7}{}{{}}{{}}} 
    6865\bibcite{GWF}{{8}{}{{}}{{}}} 
    69 \@writefile{toc}{\contentsline {section}{\numberline {7}Conclusions and future work}{18}} 
    70 \newlabel{}{{7}{18}} 
    7166\bibcite{SLURM}{{9}{}{{}}{{}}} 
    7267\bibcite{SWF}{{10}{}{{}}{{}}} 
  • papers/SMPaT-2012_DCWoRMS/elsarticle-DCWoRMS.fdb_latexmk

    r639 r648  
    11# Fdb version 2 
    2 ["pdflatex"] 1353421120 "elsarticle-DCWoRMS.tex" "elsarticle-DCWoRMS.pdf" "elsarticle-DCWoRMS"  
     2["pdflatex"] 1353507014 "elsarticle-DCWoRMS.tex" "elsarticle-DCWoRMS.pdf" "elsarticle-DCWoRMS"  
    33  "/usr/local/texlive/2010/texmf-dist/tex/context/base/supp-pdf.mkii" 1251025892 71625 fad1c4b52151c234b6873a255b0ad6b3 "" 
    44  "/usr/local/texlive/2010/texmf-dist/tex/generic/oberdiek/etexcmds.sty" 1267408169 5670 cacb018555825cfe95cd1e1317d82c1d "" 
     
    2929  "/usr/local/texlive/2010/texmf-dist/tex/latex/psnfss/upsy.fd" 1137110629 148 2da0acd77cba348f34823f44cabf0058 "" 
    3030  "/usr/local/texlive/2010/texmf-dist/tex/latex/psnfss/upzd.fd" 1137110629 148 b2a94082cb802f90d3daf6dd0c7188a0 "" 
    31   "elsarticle-DCWoRMS.aux" 1353421121 4613 d43e119df55bdee58617b8223b55ae73 "" 
    32   "elsarticle-DCWoRMS.spl" 1353421120 0 d41d8cd98f00b204e9800998ecf8427e "" 
    33   "elsarticle-DCWoRMS.tex" 1353421118 44579 8a1bab9d89af0ed388dd89500a23fc84 "" 
     31  "elsarticle-DCWoRMS.aux" 1353507015 4292 a515904da60b90122de1d94ff4164603 "" 
     32  "elsarticle-DCWoRMS.spl" 1353507015 0 d41d8cd98f00b204e9800998ecf8427e "" 
     33  "elsarticle-DCWoRMS.tex" 1353507014 45094 9a1abf23da82b60a44565767ddcb9c3a "" 
    3434  "elsarticle.cls" 1352447924 26095 ad44f4892f75e6e05dca57a3581f78d1 "" 
    3535  "fig/airModel.png" 1353405890 41411 f33639119a59ae1d2eabb277137f0042 "" 
  • papers/SMPaT-2012_DCWoRMS/elsarticle-DCWoRMS.tex

    r639 r648  
    136136\section{Introduction} 
    137137 
     138TODO - Introduction 
     139 
    138140... 
    139141 
     
    190192According to the tool evaluation presented in \cite{DCD_Romonet} an accuracy of models delivered by Romonet is at the level of 95\% when compared with metered data. The simulator is available under an OSL V3.0 open-source license, however it can be only accessed by the DCSG Members. 
    191193 
     194 
     195\subsection{Summary} 
     196 
     197TODO - short summary of current SoTA 
    192198 
    193199 
     
    331337\section{Modelling of energy efficiency in DCWoRMS} 
    332338 
     339TODO - exact models used in experimental phase (here or in the next section??)  
     340 
    333341To facilitate the simulation process, DCWoRMS provides some basic implementation of power consumption and air throughput models. 
    334342 
     
    336344 
    337345The energy consumption models provided by default can be classified into the following groups, starting from the simplest model up to the more complex ones. Users can easily switch between the given models and incorporate new, visionary scenarios. 
    338 \paragraph{\textbf{Static approach}} is based on a static definition of resource power usage. This model calculates the total amount of energy consumed by the computing resource system as a sum of energy, consumed by all its components (processors, disks, power adapters, etc.). More advanced versions of this approach assume definition of resource states along with corresponding power usage. This model follows changes of resource power states and sums up the amounts of energy defined for each state. 
    339 \paragraph{\textbf{Resource load}} model extends the static power state description and enhances it with real-time resource usage, most often simply the processor load. In this way it enables a dynamic estimation of power usage based on resource basic power usage and state (defined by the static resource description) as well as resource load. For instance, it allows distinguishing between the amount of energy used by idle processors and processors at full load. In this manner, energy consumption is directly connected with power state and describes average power usage by the resource working in a current state. 
    340 \paragraph{\textbf{Application specific}} model allows expressing differences in the amount of energy required for executing various types of applications at diverse computing resources. It considers all defined system elements (processors, memory, disk, etc.), which are significant in total energy consumption. Moreover, it also assumes that each of these components can be utilized in a different way during the experiment and thus have different impact on total energy consumption. To this end, specific characteristics of resources and applications are taken into consideration. Various approaches are possible including making the estimated power usage dependent on defined classes of applications, ratio between CPU-bound and IO-bound operations, etc. 
     346 
     347\textbf{Static approach} is based on a static definition of resource power usage. This model calculates the total amount of energy consumed by the computing resource system as a sum of energy, consumed by all its components (processors, disks, power adapters, etc.). More advanced versions of this approach assume definition of resource states along with corresponding power usage. This model follows changes of resource power states and sums up the amounts of energy defined for each state. 
     348 
     349\textbf{Resource load} model extends the static power state description and enhances it with real-time resource usage, most often simply the processor load. In this way it enables a dynamic estimation of power usage based on resource basic power usage and state (defined by the static resource description) as well as resource load. For instance, it allows distinguishing between the amount of energy used by idle processors and processors at full load. In this manner, energy consumption is directly connected with power state and describes average power usage by the resource working in a current state. 
     350 
     351\textbf{Application specific} model allows expressing differences in the amount of energy required for executing various types of applications at diverse computing resources. It considers all defined system elements (processors, memory, disk, etc.), which are significant in total energy consumption. Moreover, it also assumes that each of these components can be utilized in a different way during the experiment and thus have different impact on total energy consumption. To this end, specific characteristics of resources and applications are taken into consideration. Various approaches are possible including making the estimated power usage dependent on defined classes of applications, ratio between CPU-bound and IO-bound operations, etc. 
    341352 
    342353\subsection{Air throughput models} 
     
    344355The DCWoRMS comes with the following predefined models. 
    345356By default, air throughput estimations are performed according to the first one. 
    346 \paragraph{\textbf{Static}} model refers to a static definition of air throughput states. According to this approach, output air flow depends only on the present air cooling working state and the corresponding air throughput value. Each state change triggers the calculations and updates the current air throughput value. This strategy requires only a basic air throughput profile definition. 
    347 \paragraph{\textbf{Space}} model allows taking into account a duct associated with the investigated air flow. On the basis of the given fan rotation speed and the obstacles before/behind the fans, the output air throughput can be roughly estimated, Thus, it is possible to estimate the air flow level not only referring to the current fan operating state but also with respect to the resource and its subcomponent placement. More advanced scenario may consider mutual impact of several air flows. 
     357 
     358\textbf{Static} model refers to a static definition of air throughput states. According to this approach, output air flow depends only on the present air cooling working state and the corresponding air throughput value. Each state change triggers the calculations and updates the current air throughput value. This strategy requires only a basic air throughput profile definition. 
     359 
     360\textbf{Space} model allows taking into account a duct associated with the investigated air flow. On the basis of the given fan rotation speed and the obstacles before/behind the fans, the output air throughput can be roughly estimated, Thus, it is possible to estimate the air flow level not only referring to the current fan operating state but also with respect to the resource and its subcomponent placement. More advanced scenario may consider mutual impact of several air flows. 
    348361 
    349362\subsection{Thermal models} 
    350363The following models are supported natively. By default, the static strategy is applied. 
    351364 
    352 \paragraph{\textbf{Static}} approach follows the changes in heat, generated by the computing system components and matches the corresponding temperature according to the specified profile. Since it tracks the power consumption variations, corresponding values must be delivered, either from power consumption model or on the basis of user data. Replacing the appropriate temperature values with function based on the defined material properties and/o experimentally measured values can easily extend this model. 
    353  
    354 \paragraph{\textbf{Ambient}} model allows taking into account the surrounding cooling infrastructure. It calculates the device temperature as a function adopted from the static approach and extends it with the influence of cooling method. The efficiency of cooling system may be derived from the current air throughput value. 
     365\textbf{Static} approach follows the changes in heat, generated by the computing system components and matches the corresponding temperature according to the specified profile. Since it tracks the power consumption variations, corresponding values must be delivered, either from power consumption model or on the basis of user data. Replacing the appropriate temperature values with function based on the defined material properties and/o experimentally measured values can easily extend this model. 
     366 
     367\textbf{Ambient} model allows taking into account the surrounding cooling infrastructure. It calculates the device temperature as a function adopted from the static approach and extends it with the influence of cooling method. The efficiency of cooling system may be derived from the current air throughput value. 
    355368 
    356369\section{Experiments and evaluation} 
     
    360373.... 
    361374 
    362 In this section, we present computational analysis that were conducted to emphasize the role of modelling and simulation in studying computing systems performance. We carried out two types of experiments. The former one aimed at demonstrating the capabilities of the simulator in termis of verifying the research hypotheses. The latter set of experiments was performed CoolEmAll testbed and then repeated using DCWoRMS tool. The comparative analysis of obtained results shows the reproducibility of experiments and prove the correctness of the adopted models and assumptions. 
     375In this section, we present computational analysis that were conducted to emphasize the role of modelling and simulation in studying computing systems performance. We carried out two types of experiments. The former one aimed at demonstrating the capabilities of the simulator in termis of verifying the research hypotheses. The latter set of experiments was performed on the CoolEmAll testbed and then repeated using DCWoRMS tool. The comparative analysis of obtained results shows the reproducibility of experiments and prove the correctness of the adopted models and assumptions. 
    363376 
    364377\subsection{Testbed description} 
     
    367380compute node at operation system layer can be avoided. Furthermore this concept build up a basis on which new monitoring- and controlling-concepts can be developed. Therefore, each compute node of the RECS Cluster Server is connected to an Operation System independent microcontroller that collects the most important sensor data like temperature, power consumption and the status (on/off) from every single node. 
    368381 
     382 
     383\begin {table}[ tp] 
     384 
     385\begin{tabular}{llr} 
     386\hline 
     387\multicolumn{3}{c}{Nodes} \\ 
     388Type & Memory (RAM) & Count  \\ 
     389\hline 
     390 Intel i7 & 16 GB &     4 \\ 
     391AMD Fusion T40N 64 Bit & 4 GB   & 6 \\ 
     392Atom D510 64 Bit & 2 GB &       4 \\ 
     393Atom Z510 VT &2 GB &    4 \\ 
     394\hline 
     395\multicolumn{3}{c}{Storage} \\ 
     396Type & Size & Connection  \\ 
     397\hline 
     398Storage Head 520 & 16 x 300 GB SSD & 2 x 10 Gbit/s CX4 \\ 
     399\hline 
     400\end{tabular} 
     401\caption {CoolEmAll testbed} 
     402\end {table} 
    369403 
    370404%Node i7, 16 GB RAM     4 
     
    374408%RECS | Storage Head 520, 16 x 300 GB SSD, 2 x 10 Gbit/s CX4 
    375409 
    376 \subsection{Computattional analysis} 
    377  
    378 \section{DCWoRMS application} 
    379  
    380  
    381 DCWoRMS in CoolEmALl, integration with CFD 
     410\subsection{Computational analysis} 
     411 
     412TODO - experiments 
     413 
     414\section{DCWoRMS application/use cases} 
     415 
     416DCWoRMS in CoolEmAll, integration with CFD 
    382417 
    383418... 
    384419 
    385 Being based on the GSSIM framework, that has been successfully applied in a substantial number of research projects and academic studies, DCWoRMS with its sophisticated energy extension become an noticeable tool for studies of energy efficiency in distributed environments. For this reason, it has been adopted within the CoolEmAll project as a component of SVD Toolkit. In general the main goal of CoolEmAll is to provide advanced simulation, visualisation and decision support tools along with blueprints of computing building blocks for modular data centre environments. Once developed, these tools and blueprints should help to minimise the energy consumption, and consequently the CO2 emissions of the whole IT infrastructure with related facilities. The SVD Toolkit supports the analysis and optimization of IT modern infrastructures. 
    386  
    387 However, thermal management strategies are not the only important aspects influencing the energy efficiency of data centres. Actual power usage and effectiveness of energy saving methods heavily depends on available resources, types of applications and workload properties. Therefore, intelligent resource management policies are gaining popularity when considering the energy efficiency of IT infrastructures. 
     420Being based on the GSSIM framework, that has been successfully applied in a substantial number of research projects and academic studies, DCWoRMS with its sophisticated energy extension has become an essential tool for studies of energy efficiency in distributed environments. For this reason, it has been adopted within the CoolEmAll project as a component of SVD Toolkit. In general the main goal of CoolEmAll is to provide advanced simulation, visualisation and decision support tools along with blueprints of computing building blocks for modular data centre environments. Once developed, these tools and blueprints should help to minimise the energy consumption, and consequently the CO2 emissions of the whole IT infrastructure with related facilities. The SVD Toolkit is designed to support the analysis and optimization of IT modern infrastructures. For the recent years the special attention has been paid for energy utilized by the data centers which considerable contributes to the data center operational costs.  Actual power usage and effectiveness of energy saving methods heavily depends on available resources, types of applications and workload properties. Therefore, intelligent resource management policies are gaining popularity when considering the energy efficiency of IT infrastructures. 
    388421Hence, SVD Toolkit integrates also workload management and scheduling policies to support complex modeling and optimization of modern data centres. 
    389422 
    390 The main aim of DCWoRMS is to enable studies of dynamic states of IT infrastructures, like power consumption and air throughput distribution, on the basis of changing workloads, resource model and energy-aware resource management policies. 
    391 Workload simulation phase takes into account the specific workload and application characteristics as well as detailed resource parameters. It will benefit from the CoolEmAll benchmarks and classification of applications and workloads. In particular various types of workload, including data centre workloads using virtualization and HPC applications, may be considered. The knowledge concerning their performance and properties as well as information about their energy consumption and heat production will be used in simulations to study their impact on thermal issues and energy efficiency. The Resource model is based on DEBB description that supports modeling a data centre at various granularity levels. Besides defining simulated architecture, it is complemented with resource energy profiles that become an additional criterion in the workload management process. Based on this data workload simulation will support evaluation process of various resource management approaches. These policies may include a wide spectrum of energy-aware strategies such as workload consolidation/migration, dynamic switching off nodes, Dynamic Voltage and Frequency Scaling (DFVS), and thermal-aware methods. In addition to typical approaches minimizing energy consumption, policies that prevent too high temperatures in the presence of limited cooling (or no cooling) may also be analyzed. Moreover, apart from the set of predefined strategies, new approaches can easily be applied and examined. 
    392 The outcome of the workload simulation phase is a distribution of power usage and air throughput for the computing models specified within the SVD Toolkit. These statistics may be analyzed directly by data centre designers and administrators and/or provided as an input to the CFD simulation phase. The former case allows studying how the above metrics change over time, while the latter harness CFD simulations to identify temperature differences between the computing modules, called hot spots. The goal of this scenario is to visualise the behavior of the temperature distribution within a server room with a number of racks for different types of executed workloads and for various policies used to manage these workloads. 
     423The main aim of DCWoRMS within CoolEmAll project is to enable studies of dynamic states of IT infrastructures, like power consumption and air throughput distribution, on the basis of changing workloads, resource model and energy-aware resource management policies. 
     424In this context, DCWoRMS takes into account the specific workload and application characteristics as well as detailed resource parameters. It will benefit from the CoolEmAll benchmarks and classification of applications and workloads. In particular various types of workload, including data centre workloads using virtualization and HPC applications, may be considered. The knowledge concerning their performance and properties as well as information about their energy consumption and heat production will be used in simulations to study their impact on thermal issues and energy efficiency. Detailed resource characteristics, will be also provided according to the CoolEmAll blueprints. Based on this data, workload simulation will support evaluation process of various resource management approaches. These policies may include a wide spectrum of energy-aware strategies such as workload consolidation/migration, dynamic switching off nodes, Dynamic Voltage and Frequency Scaling (DVFS), and thermal-aware methods. In addition to typical approaches minimizing energy consumption, policies that prevent too high temperatures in the presence of limited cooling (or no cooling) may also be analyzed. Moreover, apart from the set of predefined strategies, new approaches can easily be applied and examined. 
     425The outcome of the workload and resource management simulation phase is a distribution of power usage and air throughput for the computing models specified within the SVD Toolkit. These statistics may be analyzed directly by data centre designers and administrators and/or provided as an input to the CFD simulation phase. The former case allows studying how the above metrics change over time, while the latter harness CFD simulations to identify temperature differences between the computing modules, called hot spots. The goal of this scenario is to visualise the behavior of the temperature distribution within a server room with a number of racks for different types of executed workloads and for various policies used to manage these workloads. 
    393426 
    394427 
    395428\section{Conclusions and future work} 
    396429 
     430TODO - Conclusions and future research 
    397431 
    398432 
Note: See TracChangeset for help on using the changeset viewer.