<?xml version="1.0" encoding="utf-8" ?><rss version="2.0"><channel><title><![CDATA[JavaShooter的专栏]]></title><description><![CDATA[]]></description><link>https://blog.csdn.net/JavaShooter</link><language>zh-cn</language><generator>https://blog.csdn.net/</generator><copyright><![CDATA[Copyright &copy; JavaShooter]]></copyright><item><title><![CDATA[argodb自定义函数读取hdfs文件的注意点，避免FileSystem已关闭异常]]></title><link>https://blog.csdn.net/JavaShooter/article/details/142019575</link><guid>https://blog.csdn.net/JavaShooter/article/details/142019575</guid><author>JavaShooter</author><pubDate>Sun, 08 Sep 2024 09:55:46 +0800</pubDate><description><![CDATA[顺着这一点，可以查看集群上这个配置项的值，即“fs.hdfs.impl.disable.cache”，这个值默认是false(出现性能考虑)，但这意味着hdfs文件系统的实现类(DistributedFileSystem)实例是共享、缓存的，在spark不同的executor中一旦有一个任务关闭了fs，那么其它的executor也会受到影响，这也是报fs closed异常的原因，所以将fs.hdfs.impl.disable.cache设置成true，不允许缓存fs。]]></description><category></category></item><item><title><![CDATA[nginx http 411 length required问题]]></title><link>https://blog.csdn.net/JavaShooter/article/details/49002547</link><guid>https://blog.csdn.net/JavaShooter/article/details/49002547</guid><author>JavaShooter</author><pubDate>Fri, 09 Oct 2015 17:06:58 +0800</pubDate><description><![CDATA[问题：http post访问nginx报 411 异常
解决方法：修改nginx.conf文件，http模块添加参数：chunked_transfer_encoding on;]]></description><category></category></item><item><title><![CDATA[java.io.IOException: No FileSystem for scheme: hdfs]]></title><link>https://blog.csdn.net/JavaShooter/article/details/16860637</link><guid>https://blog.csdn.net/JavaShooter/article/details/16860637</guid><author>JavaShooter</author><pubDate>Thu, 21 Nov 2013 14:26:43 +0800</pubDate><description><![CDATA[问题：NN配置成HA后，通过API读过集群各节点状态时，发生如下的异常！
java.io.IOException: No FileSystem for scheme: hdfs
没有获取到DFS!!!
解决方案：待。。。]]></description><category></category></item><item><title><![CDATA[hive  java.io.IOException: Cannot initialize Cluster]]></title><link>https://blog.csdn.net/JavaShooter/article/details/15503889</link><guid>https://blog.csdn.net/JavaShooter/article/details/15503889</guid><author>JavaShooter</author><pubDate>Tue, 12 Nov 2013 15:54:52 +0800</pubDate><description><![CDATA[环境：cdh4,hive-0.10
问题:启动hive,报 java.io.IOException: Cannot initialize Cluster，Please check your configuration for mapreduce.framework.name and the correspond server addresses.
解决：修改$HIVE_HOME/conf/hi]]></description><category></category></item><item><title><![CDATA[Exception in BPOfferService for Block pool BP]]></title><link>https://blog.csdn.net/JavaShooter/article/details/15338589</link><guid>https://blog.csdn.net/JavaShooter/article/details/15338589</guid><author>JavaShooter</author><pubDate>Mon, 11 Nov 2013 15:02:45 +0800</pubDate><description><![CDATA[集群：cdh4 
问题：启动集群后，发现datanode日志，报Exception in BPOfferService for Block pool BP.
解决：hdfs-site.xml
修改属性dfs.datanode.data.dir，配置它的值为多个目录(逗号分隔)，这个可能与属性dfs.datanode.failed.volumes.tolerated有关。]]></description><category></category></item><item><title><![CDATA[Missing Hive Builtins Jar: /data/hive-0.11.0/lib/hive-builtins-*.jar]]></title><link>https://blog.csdn.net/JavaShooter/article/details/14643815</link><guid>https://blog.csdn.net/JavaShooter/article/details/14643815</guid><author>JavaShooter</author><pubDate>Sat, 09 Nov 2013 10:24:11 +0800</pubDate><description><![CDATA[问题：编译hive-0.11，执行hive报这个错，发现$HIVE_HOME/lib下面没有hive-builtins-*.jar。
待解：]]></description><category></category></item><item><title><![CDATA[nagiosgraph nan]]></title><link>https://blog.csdn.net/JavaShooter/article/details/12711741</link><guid>https://blog.csdn.net/JavaShooter/article/details/12711741</guid><author>JavaShooter</author><pubDate>Mon, 14 Oct 2013 17:17:27 +0800</pubDate><description><![CDATA[问题：nagiosgraph图形显示 nan，无具体数字。看日志无问题，且其它的lt]]></description><category></category></item><item><title><![CDATA[hive lzo 乱码问题]]></title><link>https://blog.csdn.net/JavaShooter/article/details/12611705</link><guid>https://blog.csdn.net/JavaShooter/article/details/12611705</guid><author>JavaShooter</author><pubDate>Fri, 11 Oct 2013 10:03:42 +0800</pubDate><description><![CDATA[测试集群配置lzo，无问题。
生产环境上通过hive查询数据时，出现乱码（多出几行），应该是在解压时出现了其它的字符，通过lzop解压无问题。


解决方案：待....]]></description><category></category></item><item><title><![CDATA[mysql rank]]></title><link>https://blog.csdn.net/JavaShooter/article/details/11521017</link><guid>https://blog.csdn.net/JavaShooter/article/details/11521017</guid><author>JavaShooter</author><pubDate>Tue, 10 Sep 2013 11:33:56 +0800</pubDate><description><![CDATA[问题：取各网站pv top 10记录。
解决：rank
如下：
select site_id,pv_count,rank
from (
select A.site_id,A.pv_count,if(@site=site_id,@curRank := @curRank+1,@curRank := 1) as rank,@site := site_id
from (select site_]]></description><category></category></item><item><title><![CDATA[hive-0.11错误]]></title><link>https://blog.csdn.net/JavaShooter/article/details/9850621</link><guid>https://blog.csdn.net/JavaShooter/article/details/9850621</guid><author>JavaShooter</author><pubDate>Fri, 09 Aug 2013 10:27:10 +0800</pubDate><description><![CDATA[安装hive-0.11，执行ql，报如下错误：
2013-08-09 10:23:08,854 ERROR metastore.RetryingHMSHandler (RetryingHMSHandler.java:invoke(134)) - NoSuchObjectException(message:partition values=[2013-08-03])
        at org]]></description><category></category></item><item><title><![CDATA[编译hive错误]]></title><link>https://blog.csdn.net/JavaShooter/article/details/9471553</link><guid>https://blog.csdn.net/JavaShooter/article/details/9471553</guid><author>JavaShooter</author><pubDate>Thu, 25 Jul 2013 17:29:37 +0800</pubDate><description><![CDATA[编译hive时，出现了以下异常：
 You probably access the destination server through a proxy server that is not well configured！



原因：可能是网络配置原因，无法访问目标网站，


解决方法：待定！！！]]></description><category></category></item><item><title><![CDATA[FAILED: Error in semantic analysis: No matching method for class org.apache.hadoop.hive.ql.udf.GetEx]]></title><link>https://blog.csdn.net/JavaShooter/article/details/9448289</link><guid>https://blog.csdn.net/JavaShooter/article/details/9448289</guid><author>JavaShooter</author><pubDate>Wed, 24 Jul 2013 11:33:53 +0800</pubDate><description><![CDATA[hive 自定义UDAF
报FAILED: Error in semantic analysis: No matching method for class org.apache.hadoop.hive.ql.udf.GetExitPageUDAF with (string, string, bigint). Possible choices:


写了很多udf，udaf，居然遇到这样的]]></description><category></category></item><item><title><![CDATA[ssh 调用 hadoop问题]]></title><link>https://blog.csdn.net/JavaShooter/article/details/8940063</link><guid>https://blog.csdn.net/JavaShooter/article/details/8940063</guid><author>JavaShooter</author><pubDate>Fri, 17 May 2013 15:28:58 +0800</pubDate><description><![CDATA[Error occurred during initialization of VM
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:640)
at ja]]></description><category></category></item><item><title><![CDATA[Main class [org.apache.oozie.action.hadoop.HiveMain], exit code [10]]]></title><link>https://blog.csdn.net/JavaShooter/article/details/8880958</link><guid>https://blog.csdn.net/JavaShooter/article/details/8880958</guid><author>JavaShooter</author><pubDate>Fri, 03 May 2013 16:49:00 +0800</pubDate><description><![CDATA[oozie执行hiveql，发生这样的异常！


Main class [org.apache.oozie.action.hadoop.HiveMain], exit code [10]]]></description><category></category></item><item><title><![CDATA[如何构建一套数据计算与报表相结合的系统？]]></title><link>https://blog.csdn.net/JavaShooter/article/details/8867625</link><guid>https://blog.csdn.net/JavaShooter/article/details/8867625</guid><author>JavaShooter</author><pubDate>Mon, 29 Apr 2013 19:29:52 +0800</pubDate><description><![CDATA[做一套这样的系统：
1.各类数据可以灵活定义，描述
2.各类数据可以以多种方式导入系统
3.对各类数据可以方便的形成计算任务，进行任务调度管理
4.计算结果可以方便地形成图表
 
各位大神，您有何高见!]]></description><category></category></item><item><title><![CDATA[java.sql.SQLException: Field 'IS_STOREDASSUBDIRECTORIES' doesn't have a default value]]></title><link>https://blog.csdn.net/JavaShooter/article/details/8866371</link><guid>https://blog.csdn.net/JavaShooter/article/details/8866371</guid><author>JavaShooter</author><pubDate>Mon, 29 Apr 2013 11:32:16 +0800</pubDate><description><![CDATA[今天在添加表分区遇到如下的异常：
ALTER TABLE s_search_log ADD IF NOT EXISTS PARTITION (day_id =20130428, PLAT_TYPE=3) 
LOCATION '/data/stg/s_search_log/20130428/3/';
异常：
FAILED: Error in metadata: javax.jdo.JDODa]]></description><category></category></item><item><title><![CDATA[hive表乱码问题]]></title><link>https://blog.csdn.net/JavaShooter/article/details/8781255</link><guid>https://blog.csdn.net/JavaShooter/article/details/8781255</guid><author>JavaShooter</author><pubDate>Wed, 10 Apr 2013 09:58:42 +0800</pubDate><description><![CDATA[1.导入到hdfs的文件是gbk编码
2.创建hive的外表部，引用gbk编码文件.hive数据utf-8编码。
3.cli查询出中文为乱码


由于数据入hive表中已为乱码，此时再进行转码已无效。]]></description><category></category></item><item><title><![CDATA[stop-hbase.sh  no zookeeper to stop because no pid file /tmp/hbase-hadoop-zookeeper.pid]]></title><link>https://blog.csdn.net/JavaShooter/article/details/8674343</link><guid>https://blog.csdn.net/JavaShooter/article/details/8674343</guid><author>JavaShooter</author><pubDate>Thu, 14 Mar 2013 17:47:38 +0800</pubDate><description><![CDATA[关闭hbase时，发现这样的提示：
no zookeeper to stop because no pid file /tmp/hbase-hadoop-zookeeper.pid


原因：无法找到zk.pid文件，可能是由于放到/tmp造成]]></description><category></category></item><item><title><![CDATA[restlet例子介绍]]></title><link>https://blog.csdn.net/JavaShooter/article/details/8643534</link><guid>https://blog.csdn.net/JavaShooter/article/details/8643534</guid><author>JavaShooter</author><pubDate>Wed, 06 Mar 2013 18:15:33 +0800</pubDate><description><![CDATA[一篇关于restlet例子的文档，写的不错。
http://www.docin.com/p-401845817.html]]></description><category></category></item><item><title><![CDATA[专利文章搜索]]></title><link>https://blog.csdn.net/JavaShooter/article/details/8573391</link><guid>https://blog.csdn.net/JavaShooter/article/details/8573391</guid><author>JavaShooter</author><pubDate>Wed, 06 Feb 2013 10:20:46 +0800</pubDate><description><![CDATA[http://search.patentstar.com.cn
很不错的一个关于专利文章搜索方面的网站。]]></description><category></category></item></channel></rss>