ClusterMonitoring » History » Version 1
Anonymous, 09/14/2007 10:27 AM
| 1 | 1 | Anonymous | = Cluster Monitoring = |
|---|---|---|---|
| 2 | 1 | Anonymous | The cluster resources and performance needs to be constantly monitored, and the users need to be tracked. |
| 3 | 1 | Anonymous | |
| 4 | 1 | Anonymous | We assume the following configuration: |
| 5 | 1 | Anonymous | ||Ganglia || 3.0.4 |
| 6 | 1 | Anonymous | ||!JobMonarch || 0.2 |
| 7 | 1 | Anonymous | |
| 8 | 1 | Anonymous | == Ganglia == |
| 9 | 1 | Anonymous | ''Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids.'' |
| 10 | 1 | Anonymous | |
| 11 | 1 | Anonymous | * Download the latest release of the ''Ganglia Monitoring Core'' from [http://ganglia.sourceforge.net/ http://ganglia.sourceforge.net]. |
| 12 | 1 | Anonymous | * Install Ganglia into ''/usr/local/ganglia'', its web frontend into ''/usr/local/ganglia/html/', and its databases into ''/usr/local/ganglia/rrds/'. |
| 13 | 1 | Anonymous | * Install the ''Ganglia Monitoring Daemon'' (gmond) on each node, and the ''Ganglia Meta Daemon'' (gmetad) on the the head node. |
| 14 | 1 | Anonymous | |
| 15 | 1 | Anonymous | === Ganglia Monitoring Daemon === |
| 16 | 1 | Anonymous | * Configure, build and install Ganglia on each slave node (only with ''gmond''): |
| 17 | 1 | Anonymous | {{{ |
| 18 | 1 | Anonymous | ./configure --prefix=/usr/local |
| 19 | 1 | Anonymous | }}} |
| 20 | 1 | Anonymous | and on the master node (with ''gmond'' and ''gmetad''): |
| 21 | 1 | Anonymous | {{{ |
| 22 | 1 | Anonymous | ./configure --prefix=/usr/local --with-gmeta |
| 23 | 1 | Anonymous | }}} |
| 24 | 1 | Anonymous | |
| 25 | 1 | Anonymous | * Initialise the configuration file for ''gmond'': |
| 26 | 1 | Anonymous | {{{ |
| 27 | 1 | Anonymous | gmond --default >> /etc/gmond.conf |
| 28 | 1 | Anonymous | }}} |
| 29 | 1 | Anonymous | |
| 30 | 1 | Anonymous | * Configure the ''Ganglia Monitoring Daemon'' in ''/etc/gmond.conf'': |
| 31 | 1 | Anonymous | * Set the name of the cluster: |
| 32 | 1 | Anonymous | {{{ |
| 33 | 1 | Anonymous | cluster { |
| 34 | 1 | Anonymous | name = "ProCKSI" |
| 35 | 1 | Anonymous | } |
| 36 | 1 | Anonymous | }}} |
| 37 | 1 | Anonymous | * Set the IP address and port for multicast data exchange: |
| 38 | 1 | Anonymous | {{{ |
| 39 | 1 | Anonymous | udp_send_channel { |
| 40 | 1 | Anonymous | mcast_join = 239.2.11.71 |
| 41 | 1 | Anonymous | port = 8649 |
| 42 | 1 | Anonymous | } |
| 43 | 1 | Anonymous | udp_recv_channel { |
| 44 | 1 | Anonymous | mcast_join = 239.2.11.71 |
| 45 | 1 | Anonymous | port = 8649 |
| 46 | 1 | Anonymous | bind = 239.2.11.71 |
| 47 | 1 | Anonymous | } |
| 48 | 1 | Anonymous | }}} |
| 49 | 1 | Anonymous | |
| 50 | 1 | Anonymous | * Copy start-up script for ''gmond'': |
| 51 | 1 | Anonymous | {{{ |
| 52 | 1 | Anonymous | cp ./gmond/gmond.init /etc/init.d/gmond |
| 53 | 1 | Anonymous | }}} |
| 54 | 1 | Anonymous | |
| 55 | 1 | Anonymous | * Add additional route for correct data exchange via multicast using the ''internal'' interface (''eth0''). Modify ''/etc/inid.d/gmond'': |
| 56 | 1 | Anonymous | {{{ |
| 57 | 1 | Anonymous | #Add multicast route to internal interface |
| 58 | 1 | Anonymous | /sbin/route add -host 239.2.11.71 dev eth0 |
| 59 | 1 | Anonymous | daemon $GMOND |
| 60 | 1 | Anonymous | }}} |
| 61 | 1 | Anonymous | {{{ |
| 62 | 1 | Anonymous | #Remove multicast route to internal interface |
| 63 | 1 | Anonymous | /sbin/route delete -host 239.2.11.71 dev eth0 |
| 64 | 1 | Anonymous | killproc gmond |
| 65 | 1 | Anonymous | }}} |
| 66 | 1 | Anonymous | * Make the Ganglia Monitoring Daemon start at bootup. |
| 67 | 1 | Anonymous | {{{ |
| 68 | 1 | Anonymous | /sbin/chkconfig gmond on |
| 69 | 1 | Anonymous | }}} |
| 70 | 1 | Anonymous | * Start the Ganglia Monitoring Daemon: |
| 71 | 1 | Anonymous | {{{ |
| 72 | 1 | Anonymous | /sbin/service gmond start |
| 73 | 1 | Anonymous | }}} |
| 74 | 1 | Anonymous | |
| 75 | 1 | Anonymous | === Ganglia Meta Daemon === |
| 76 | 1 | Anonymous | * Install and configure the ''Ganglia Meta Daeomn'' (gmetad) on the master node. |
| 77 | 1 | Anonymous | |
| 78 | 1 | Anonymous | * Make the Ganglia Meta Daemon start at bootup. |
| 79 | 1 | Anonymous | {{{ |
| 80 | 1 | Anonymous | /sbin/chkconfig --add gmetad |
| 81 | 1 | Anonymous | /sbin/chkconfig gmetad on |
| 82 | 1 | Anonymous | }}} |
| 83 | 1 | Anonymous | * Start the Ganglia Meta Daemon: |
| 84 | 1 | Anonymous | {{{ |
| 85 | 1 | Anonymous | /sbin/service gmetad start |
| 86 | 1 | Anonymous | }}} |
| 87 | 1 | Anonymous | |
| 88 | 1 | Anonymous | * If the pie chart diagrams do not show up, you have to install the ''php-gd'' packages. |
| 89 | 1 | Anonymous | |
| 90 | 1 | Anonymous | |
| 91 | 1 | Anonymous | === Further Customisation === |
| 92 | 1 | Anonymous | In order to display more fine-grained time intervals, edit the following files in ''/usr/local/ganglia/html/'': |
| 93 | 1 | Anonymous | * '''header.php''' |
| 94 | 1 | Anonymous | {{{ |
| 95 | 1 | Anonymous | if (!$physical) { |
| 96 | 1 | Anonymous | $context_ranges[]="10 minutes"; |
| 97 | 1 | Anonymous | $context_ranges[]="20 minutes"; |
| 98 | 1 | Anonymous | $context_ranges[]="30 minutes"; |
| 99 | 1 | Anonymous | $context_ranges[]="1 hour"; |
| 100 | 1 | Anonymous | $context_ranges[]="2 hours"; |
| 101 | 1 | Anonymous | $context_ranges[]="4 hours"; |
| 102 | 1 | Anonymous | $context_ranges[]="8 hours"; |
| 103 | 1 | Anonymous | $context_ranges[]="12 hours"; |
| 104 | 1 | Anonymous | $context_ranges[]="1 day"; |
| 105 | 1 | Anonymous | $context_ranges[]="2 days"; |
| 106 | 1 | Anonymous | $context_ranges[]="week"; |
| 107 | 1 | Anonymous | $context_ranges[]="month"; |
| 108 | 1 | Anonymous | $context_ranges[]="year"; |
| 109 | 1 | Anonymous | }}} |
| 110 | 1 | Anonymous | |
| 111 | 1 | Anonymous | * '''get_context.php''' |
| 112 | 1 | Anonymous | {{{ |
| 113 | 1 | Anonymous | switch ($range) { |
| 114 | 1 | Anonymous | case "10 minutes": $start = -600; break; |
| 115 | 1 | Anonymous | case "20 minutes": $start = -1200; break; |
| 116 | 1 | Anonymous | case "30 minutes": $start = -1800; break; |
| 117 | 1 | Anonymous | case "1 hour": $start = -3600; break; |
| 118 | 1 | Anonymous | case "2 hours": $start = -7200; break; |
| 119 | 1 | Anonymous | case "4 hours": $start = -14400; break; |
| 120 | 1 | Anonymous | case "8 hours": $start = -28800; break; |
| 121 | 1 | Anonymous | case "12 hours": $start = -43200; break; |
| 122 | 1 | Anonymous | case "1 day": $start = -86400; break; |
| 123 | 1 | Anonymous | case "2 days": $start = -172800; break; |
| 124 | 1 | Anonymous | case "week": $start = -604800; break; |
| 125 | 1 | Anonymous | case "month": $start = -2419200; break; |
| 126 | 1 | Anonymous | case "year": $start = -31449600; break; |
| 127 | 1 | Anonymous | }}} |
| 128 | 1 | Anonymous | |
| 129 | 1 | Anonymous | |
| 130 | 1 | Anonymous | == !JobMonarch == |
| 131 | 1 | Anonymous | !JobMonarch is an add-on to Ganglia which provides PBS job monitoring through the web browser. |
| 132 | 1 | Anonymous | |
| 133 | 1 | Anonymous | See [http://subtrac.rc.sara.nl/oss/jobmonarch/wiki/Documentation http://subtrac.rc.sara.nl/oss/jobmonarch/wiki/Documentation] for information on requirements, configuration and installation. |
| 134 | 1 | Anonymous | |
| 135 | 1 | Anonymous | '''Attention''': Does not work properly yet. |
| 136 | 1 | Anonymous | |
| 137 | 1 | Anonymous | |
| 138 | 1 | Anonymous | == Domain Usage Monitoring == |
| 139 | 1 | Anonymous | All HTML documents must contain the following code in order to be tracked correctly. |
| 140 | 1 | Anonymous | |
| 141 | 1 | Anonymous | {{{ |
| 142 | 1 | Anonymous | <!-- Site Meter --> |
| 143 | 1 | Anonymous | <script type="text/javascript" src="http://s18.sitemeter.com/js/counter.js?site=s18procksi"> |
| 144 | 1 | Anonymous | </script> |
| 145 | 1 | Anonymous | <noscript> |
| 146 | 1 | Anonymous | <a href="http://s18.sitemeter.com/stats.asp?site=s18procksi" target="_top"> |
| 147 | 1 | Anonymous | <img src=[http://s18.sitemeter.com/meter.asp?site=s18procksi http://s18.sitemeter.com/meter.asp?site=s18procksi] |
| 148 | 1 | Anonymous | alt="Site Meter" border="0"/> |
| 149 | 1 | Anonymous | </a> |
| 150 | 1 | Anonymous | </noscript> |
| 151 | 1 | Anonymous | |
| 152 | 1 | Anonymous | <!-- Copyright (c)2006 Site Meter --> |
| 153 | 1 | Anonymous | }}} |