Ganglia的安装
wangjunyi 2016-08-19
Ganglia是UC Berkeley发起的一个开源集群监视项目，设计用于测量数以千计的节点。Ganglia的核心包含gmond、gmetad以及一个Web前端。主要是用来监控系统性能，如：cpu 、mem、硬盘利用率， I/O负载、网络流量情况等，通过曲线很容易见到每个节点的工作状态，对合理调整、分配系统资源，提高系统整体性能起到重要作用。
Ganglia的安装，可以使用yum和rpm来进行，对于刚装的系统需要分别执行以下几个命令，来完成初始化安装：
yum install –y wget apr-devel apr-util check-devel cairo-devel pango-devel libxml2-devel rpmbuild glib2-devel dbus-devel freetype-devel fontconfig-devel gcc-c++ expat-devel python-devel libXrender-devel rrdtool* rpm -ivh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm rpm -ivh http://rpms.famillecollet.com/enterprise/remi-release-6.rpm rpm -ivh http://github.com/downloads/jmxtrans/jmxtrans/jmxtrans-20121016.145842.6a28c97fbb-0.noarch.rpm yum install ganglia*
yum install –y wget apr-devel apr-util check-devel cairo-devel pango-devel libxml2-devel rpmbuild glib2-devel dbus-devel freetype-devel fontconfig-devel gcc-c++ expat-devel python-devel libXrender-devel rrdtool* rpm -ivh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm rpm -ivh http://rpms.famillecollet.com/enterprise/remi-release-6.rpm rpm -ivh http://github.com/downloads/jmxtrans/jmxtrans/jmxtrans-20121016.145842.6a28c97fbb-0.noarch.rpm yum install ganglia*
安装完成后，即可配置。
1， 修改ganglia的conf配置，
修改 /etc/ganglia/gmetad.conf，数据源的配置
data_source "solr cluster" 127.0.0.1
集群IP，可以设置多个IP地址，也可以设置多个数据源。
2，修改 /etc/ganglia/gmond.conf的配置，把name对应起来
cluster {
name = "solr cluster"
owner = "unspecified"
latlong = "unspecified"
url = "unspecified"
}
3，修改/etc/httpd/conf.d/ganglia.conf，Apache的配置，不拦截ganglia的数据包
Alias /ganglia /usr/share/ganglia
<Location /ganglia>
Order deny,allow
Allow from all
Allow from 192.168.46.21
Allow from ::1
# Allow from .example.com
</Location>
4，cd /var/lib/jmxtrans
配置jmxtrans
添加solr.json
solr.json的配置如下：
{
"servers" : [
{
"host" : "192.168.46.23",
"alias" : "solr23",
"port" : "3000",
"queries" : [
{
"obj" : "java.lang:type=Memory",
"resultAlias": "solr23.heap",
"attr" : [ "HeapMemoryUsage", "NonHeapMemoryUsage" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
},
{
"obj" : "java.lang:name=CMS Old Gen,type=MemoryPool",
"resultAlias": "solr23.cmsoldgen",
"attr" : [ "Usage" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
},
{
"obj" : "java.lang:type=GarbageCollector,name=*",
"resultAlias": "solr23.gc",
"attr" : [ "CollectionCount", "CollectionTime" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
},
{
"obj" : "java.lang:type=Threading",
"resultAlias": "solr23.threads",
"attr" : [ "DaemonThreadCount", "PeakThreadCount", "ThreadCount", "TotalStartedThreadCount" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
},
{
"obj" : "solr/collection1:type=queryResultCache,id=org.apache.solr.search.LRUCache",
"resultAlias": "solr23.queryCache",
"attr" : [ "warmupTime","size","lookups","evictions","hits","hitratio","inserts","cumulative_lookups","cumulative_hits","cumulative_hits","cumulative_hitratio","cumulative_inserts","cumulative_evictions" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
},
{
"obj" : "solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher",
"resultAlias": "solr23.searcher",
"attr" : [ "maxDoc","numDocs","warmupTime" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
}]
}]
} {
"servers" : [
{
"host" : "192.168.46.23",
"alias" : "solr23",
"port" : "3000",
"queries" : [
{
"obj" : "java.lang:type=Memory",
"resultAlias": "solr23.heap",
"attr" : [ "HeapMemoryUsage", "NonHeapMemoryUsage" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
},
{
"obj" : "java.lang:name=CMS Old Gen,type=MemoryPool",
"resultAlias": "solr23.cmsoldgen",
"attr" : [ "Usage" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
},
{
"obj" : "java.lang:type=GarbageCollector,name=*",
"resultAlias": "solr23.gc",
"attr" : [ "CollectionCount", "CollectionTime" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
},
{
"obj" : "java.lang:type=Threading",
"resultAlias": "solr23.threads",
"attr" : [ "DaemonThreadCount", "PeakThreadCount", "ThreadCount", "TotalStartedThreadCount" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
},
{
"obj" : "solr/collection1:type=queryResultCache,id=org.apache.solr.search.LRUCache",
"resultAlias": "solr23.queryCache",
"attr" : [ "warmupTime","size","lookups","evictions","hits","hitratio","inserts","cumulative_lookups","cumulative_hits","cumulative_hits","cumulative_hitratio","cumulative_inserts","cumulative_evictions" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
},
{
"obj" : "solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher",
"resultAlias": "solr23.searcher",
"attr" : [ "maxDoc","numDocs","warmupTime" ],
"outputWriters" : [
{
"@class" : "com.googlecode.jmxtrans.model.output.GangliaWriter",
"settings" : {
"groupName" : "Solr-JVM",
"host" : "239.2.11.71",
"port" : "8649"
}
}]
}]
}]
}
配置完成后，需要依次，启动如下服务：
service httpd start //启动apache服务 /etc/init.d/gmetad start //启动绘图服务 /etc/init.d/gmond start //启动数据收集服务 这个放在solr前执行 jmx /etc/init.d/jmxtrans start //启动jmx /home/solr/start-solr.sh //启动solr
service httpd start //启动apache服务 /etc/init.d/gmetad start //启动绘图服务 /etc/init.d/gmond start //启动数据收集服务 这个放在solr前执行 jmx /etc/init.d/jmxtrans start //启动jmx /home/solr/start-solr.sh //启动solr
注意，solr启动的jetty的jar需要加上JMX的监控参数，内容如下：
java -Djava.rmi.server.hostname=192.168.46.23 -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=3000 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -jar start.jar
java -Djava.rmi.server.hostname=192.168.46.23 -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=3000 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -jar start.jar
最后需要注意一点，为了防止访问apache服务出错，
如果出现：There was an error collecting ganglia data (127.0.0.1:8652): fsockopen error: Permission denied . 错误，我们需要进行以下的设置：
（1）：临时可以使用命令setenforce 0来关闭selinux而不需要重启，刷新页面，即可访问！ （2）:永久的使用，需要关闭selinux：vi /etc/selinux/config，把SELINUX=enforcing改成SELINUX=disable；需要重启机器。
（1）：临时可以使用命令setenforce 0来关闭selinux而不需要重启，刷新页面，即可访问！ （2）:永久的使用，需要关闭selinux：vi /etc/selinux/config，把SELINUX=enforcing改成SELINUX=disable；需要重启机器。
一切完成后，我们就是访问我们本机的ip地址，看到的界面如下所示： 
到此，我们的单机监控solr的demo，就部署成功了，以同样的方式，我们还可以对hadoop进行监控，另外我们还可以配置多个datasource来监控多个应用。
相关推荐
wanfuchun 0喜欢 / 0评论 2020-05-14
Ephemeroptera 0喜欢 / 0评论 2016-08-19
tryhl 0喜欢 / 0评论 2011-05-12
wanfuchun 0喜欢 / 0评论 2019-10-24
Beryl 0喜欢 / 0评论 2014-06-28
chumeng 0喜欢 / 0评论 2012-02-21
jacktangj 0喜欢 / 0评论 2011-11-13
wuxiaobingandbob 0喜欢 / 0评论 2011-06-24
风韵雪ForCSDN 0喜欢 / 0评论 2013-10-12
朝花amp夕拾 0喜欢 / 0评论 2011-03-04
wanfuchun 0喜欢 / 0评论 2015-08-28
vitasfly 0喜欢 / 0评论 2014-12-20
manquyuan00 0喜欢 / 0评论 2010-11-09
linkcloud 0喜欢 / 0评论 2013-01-10
youyou 0喜欢 / 0评论 2010-11-01
Beryl 0喜欢 / 0评论 2010-07-22
朝花amp夕拾 0喜欢 / 0评论 2012-08-30
wuxiaobingandbob 0喜欢 / 0评论 2010-03-22
Ephemeroptera 0喜欢 / 0评论 2016-08-19
duyue0 0喜欢 / 0评论 2016-08-19
liongxiong 0喜欢 / 0评论 2012-05-25
duyue0 0喜欢 / 0评论 2012-05-22
朝花amp夕拾 0喜欢 / 0评论 2011-02-11
AndyViky 0喜欢 / 0评论 2011-02-10
duanyajun 0喜欢 / 0评论 2019-06-20
刀刀鱼 0喜欢 / 0评论 2014-02-24
renzeGIS 0喜欢 / 0评论 2018-11-27
梁鹏 0喜欢 / 0评论 2014-10-01
jswawa 0喜欢 / 0评论 2014-04-05
朝花amp夕拾 0喜欢 / 0评论 2014-04-05
duyue0 0喜欢 / 0评论 2014-04-05
xqhadoop 0喜欢 / 0评论 2013-06-12
AndyViky 0喜欢 / 0评论 2012-12-13
Beryl 0喜欢 / 0评论 2012-10-28
chenzhikaida 0喜欢 / 0评论 2018-03-21
lay 0喜欢 / 0评论 2014-04-25
youyou 0喜欢 / 0评论 2017-03-24
freezl 0喜欢 / 0评论 2017-03-10
朝花amp夕拾 0喜欢 / 0评论 2016-08-28
wangjunyi 0喜欢 / 0评论 2016-08-27
Linux 0喜欢 / 0评论 2017-02-05
youyou 0喜欢 / 0评论 2016-03-27
wanfuchun 0喜欢 / 0评论 2010-07-19
AndyViky 0喜欢 / 0评论 2015-12-13
zhangsh00 0喜欢 / 0评论 2015-09-13
youyou 0喜欢 / 0评论 2015-08-08
zhengyshan 0喜欢 / 0评论 2015-08-08
AndyViky 0喜欢 / 0评论 2015-08-08