Taiwan Hadoop Forum

台灣 Hadoop 技術討論區
現在的時間是 2020-08-04, 21:41

所有顯示的時間為 UTC + 8 小時




發表新文章 回覆主題  [ 2 篇文章 ] 
發表人 內容
 文章主題 : hadoop 程式問題
文章發表於 : 2013-10-28, 18:28 
離線

註冊時間: 2013-10-28, 18:09
文章: 1
相同的程式重新編輯出現錯誤:
13/10/28 18:21:34 INFO mapred.FileInputFormat: Total input paths to process : 1
13/10/28 18:21:35 INFO mapred.JobClient: Running job: job_201309060021_3128
13/10/28 18:21:36 INFO mapred.JobClient: map 0% reduce 0%
13/10/28 18:21:43 INFO mapred.JobClient: map 50% reduce 0%
13/10/28 18:21:46 INFO mapred.JobClient: map 100% reduce 0%
13/10/28 18:21:53 INFO mapred.JobClient: map 100% reduce 33%
13/10/28 18:21:55 INFO mapred.JobClient: Task Id : attempt_201309060021_3128_r_000000_0, Status : FAILED
java.lang.NumberFormatException: For input string: "8.65 Google,MSN,Yahoo,"
at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1222)
at java.lang.Float.valueOf(Float.java:388)
at PageRank$Reduce.reduce(PageRank.java:89)
at PageRank$Reduce.reduce(PageRank.java:76)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at org.apache.hadoop.mapred.Child.main(Child.java:170)

13/10/28 18:21:56 INFO mapred.JobClient: map 100% reduce 0%
13/10/28 18:22:05 INFO mapred.JobClient: map 100% reduce 16%
13/10/28 18:22:07 INFO mapred.JobClient: Task Id : attempt_201309060021_3128_r_000000_1, Status : FAILED
java.lang.NumberFormatException: For input string: "8.65 Google,MSN,Yahoo,"
at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1222)
at java.lang.Float.valueOf(Float.java:388)
at PageRank$Reduce.reduce(PageRank.java:89)
at PageRank$Reduce.reduce(PageRank.java:76)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at org.apache.hadoop.mapred.Child.main(Child.java:170)

attempt_201309060021_3128_r_000000_1: log4j:WARN No appenders could be found for logger (org.apache.hadoop.hdfs.DFSClient).
attempt_201309060021_3128_r_000000_1: log4j:WARN Please initialize the log4j system properly.
13/10/28 18:22:08 INFO mapred.JobClient: map 100% reduce 0%
13/10/28 18:22:17 INFO mapred.JobClient: map 100% reduce 33%
13/10/28 18:22:19 INFO mapred.JobClient: Task Id : attempt_201309060021_3128_r_000000_2, Status : FAILED
java.lang.NumberFormatException: For input string: "8.65 Google,MSN,Yahoo,"
at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1222)
at java.lang.Float.valueOf(Float.java:388)
at PageRank$Reduce.reduce(PageRank.java:89)
at PageRank$Reduce.reduce(PageRank.java:76)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at org.apache.hadoop.mapred.Child.main(Child.java:170)

13/10/28 18:22:20 INFO mapred.JobClient: map 100% reduce 0%
13/10/28 18:22:32 INFO mapred.JobClient: map 100% reduce 33%
13/10/28 18:22:35 INFO mapred.JobClient: map 100% reduce 0%
13/10/28 18:22:37 INFO mapred.JobClient: Job complete: job_201309060021_3128
13/10/28 18:22:37 INFO mapred.JobClient: Counters: 15
13/10/28 18:22:37 INFO mapred.JobClient: Job Counters
13/10/28 18:22:37 INFO mapred.JobClient: Launched reduce tasks=4
13/10/28 18:22:37 INFO mapred.JobClient: Rack-local map tasks=1
13/10/28 18:22:37 INFO mapred.JobClient: Launched map tasks=2
13/10/28 18:22:37 INFO mapred.JobClient: Data-local map tasks=1
13/10/28 18:22:37 INFO mapred.JobClient: Failed reduce tasks=1
13/10/28 18:22:37 INFO mapred.JobClient: FileSystemCounters
13/10/28 18:22:37 INFO mapred.JobClient: HDFS_BYTES_READ=133
13/10/28 18:22:37 INFO mapred.JobClient: FILE_BYTES_WRITTEN=230
13/10/28 18:22:37 INFO mapred.JobClient: PageRank$PageCount
13/10/28 18:22:37 INFO mapred.JobClient: INPUT_WORDS=4
13/10/28 18:22:37 INFO mapred.JobClient: Map-Reduce Framework
13/10/28 18:22:37 INFO mapred.JobClient: Combine output records=7
13/10/28 18:22:37 INFO mapred.JobClient: Map input records=4
13/10/28 18:22:37 INFO mapred.JobClient: Spilled Records=7
13/10/28 18:22:37 INFO mapred.JobClient: Map output bytes=153
13/10/28 18:22:37 INFO mapred.JobClient: Map input bytes=88
13/10/28 18:22:37 INFO mapred.JobClient: Combine input records=11
13/10/28 18:22:37 INFO mapred.JobClient: Map output records=11
Exception in thread "main" java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
at PageRank.run(PageRank.java:136)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at PageRank.main(PageRank.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
不知道有沒有人遇到過相同問題
非常感謝!!


回頂端
 個人資料 E-mail  
 
 文章主題 : Re: hadoop 程式問題
文章發表於 : 2013-10-29, 00:39 
離線

註冊時間: 2009-11-09, 19:52
文章: 2897
marcuzx 寫:
13/10/28 18:21:55 INFO mapred.JobClient: Task Id : attempt_201309060021_3128_r_000000_0, Status : FAILED
java.lang.NumberFormatException: For input string: "8.65 Google,MSN,Yahoo,"
at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1222)
13/10/28 18:22:07 INFO mapred.JobClient: Task Id : attempt_201309060021_3128_r_000000_1, Status : FAILED
java.lang.NumberFormatException: For input string: "8.65 Google,MSN,Yahoo,"
at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1222)
13/10/28 18:22:19 INFO mapred.JobClient: Task Id : attempt_201309060021_3128_r_000000_2, Status : FAILED
java.lang.NumberFormatException: For input string: "8.65 Google,MSN,Yahoo,"
at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1222)


感覺上應該是輸入資料格式有問題所造成。
是否該先切 token ,將 8.65 跟 "Google,MSN,Yahoo," 切開。然後才讀入 8.65 呢?

- Jazz


回頂端
 個人資料 E-mail  
 
顯示文章 :  排序  
發表新文章 回覆主題  [ 2 篇文章 ] 

所有顯示的時間為 UTC + 8 小時


誰在線上

正在瀏覽這個版面的使用者:沒有註冊會員 和 4 位訪客


不能 在這個版面發表主題
不能 在這個版面回覆主題
不能 在這個版面編輯您的文章
不能 在這個版面刪除您的文章
不能 在這個版面上傳附加檔案

搜尋:
前往 :  
cron
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
正體中文語系由 竹貓星球 維護製作