[go: up one dir, main page]
Menu ▾ ▴

How can I retrieve log messages?

Crossbow Help
Nobody/Anonymous
2011-09-29
2013-06-05

  • Nobody/Anonymous

    Nobody/Anonymous - 2011-09-29

    Hi,

    I'm running crossbow on hadoop 0.21.0 and during preprocessing it fails (see message below) - how can I find out what's going wrong?

    ==========================
    Stage 1 of 4. Preprocess
    ==========================
    Thu Sep 29 07:02:57 EDT 2011
    11/09/29 07:02:57 WARN streaming.StreamJob: -file option is deprecated, please use generic option -files instead.
    11/09/29 07:02:57 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
    11/09/29 07:02:58 WARN conf.Configuration: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
    packageJobJar:   /tmp/streamjob6368026984759886209.jar tmpDir=null
    11/09/29 07:02:58 WARN mapreduce.JobSubmitter: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
    11/09/29 07:02:58 INFO mapred.FileInputFormat: Total input paths to process : 1
    11/09/29 07:03:07 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
    11/09/29 07:03:07 INFO mapreduce.JobSubmitter: number of splits:1499999
    11/09/29 07:03:07 INFO mapreduce.JobSubmitter: adding the following namenodes' delegation tokens:null
    11/09/29 07:03:07 INFO streaming.StreamJob: getLocalDirs():
    11/09/29 07:03:07 INFO streaming.StreamJob: Running job: job_201109290641_0005
    11/09/29 07:03:07 INFO streaming.StreamJob: To kill this job, run:
    11/09/29 07:03:07 INFO streaming.StreamJob: /root/hadoop-0.21.0/bin/../bin/hadoop job  -Dmapreduce.jobtracker.address=hadoopmaster:9001 -kill job_201109290641_0005
    11/09/29 07:03:07 INFO streaming.StreamJob: Tracking URL: http://hadoopmaster:50030/jobdetails.jsp?jobid=job_201109290641_0005
    11/09/29 07:03:08 INFO streaming.StreamJob:  map 100%  reduce 100%
    11/09/29 07:03:08 INFO streaming.StreamJob: To kill this job, run:
    11/09/29 07:03:08 INFO streaming.StreamJob: /root/hadoop-0.21.0/bin/../bin/hadoop job  -Dmapreduce.jobtracker.address=hadoopmaster:9001 -kill job_201109290641_0005
    11/09/29 07:03:08 INFO streaming.StreamJob: Tracking URL: http://hadoopmaster:50030/jobdetails.jsp?jobid=job_201109290641_0005
    11/09/29 07:03:08 ERROR streaming.StreamJob: Job not Successful!
    11/09/29 07:03:08 INFO streaming.StreamJob: killJob…
    Streaming Command Failed!
    Non-zero exitlevel from Preprocess stage

     

Log in to post a comment.