18183游戏网 - 专注分享最好的电脑系统软件!免费安全下载 18183游戏网首页 | Win7激活工具 | 热门专题
18183游戏网> > 系统教程 > Win10系统教程 >

Win10安装Hadoop3.1.2教程图文

更新时间:2026-08-21 16:44:14 | 编辑:心蛊 | 信息来源:互联网
由于工作学习需要很多用户需要在Win10系统下安装Hadoop,今天小编就详细分享下Win10中安装Hadoop的教程图文详细资料。


安装环境:

JDK 1.8
Windows10
Hadoop3.1.2

需要注意的是jdk版本不要过高,否则可能会带来问题

一、安装Hadoop步骤

官网下载Hadoop3.1.2 :下载地址

解压到自定义的文件夹,我这里选择我的路径

F:\Environment\hadoop-3.1.2\hadoop


 

配置环境变量

JAVA_HOME : F:\Environment\java\jdk1.8.0_181HADOOP_HOME : F:\Environment\hadoop-3.1.2\hadooppath添加 : %JAVA_HOME%\bin %JAVA_HOME%\jre\bin %HADOOP_HOME%\bin



检测是否安装成功

java -versionhadoop - version

出现以上信息说明安装成功 !

二、修改配置文件

1、需要修改的文件在解压后的目录下,F:\Environment\hadoop-3.1.2\hadoop\etc\hadoop



hadoop-env.cmd

用Notepad++ 打开hadoop-env.cmd文件找到**set JAVA_HOME=%JAVA_HOME%**一行,将其值修改为jdk所在目录如果目录带有空格,可以通过下面两种方式处理:这里以安装目录为C:\Program Files\Java\jdk1.8.0_181为例因为Program Files中存在空格,若是直接使用会出现错误,可以下面两种方式之一进行处理:只需要用PROGRA~1 代替Program Files,即改为C:\PROGRA~1\Java\jdk1.8.0_18或是使用双引号改为 “C:\Program Files”\Java\jdk1.8.0_181core-site.xml

fs.defaultFS hdfs://localhost:9000 mapred-site.xml

mapreduce.framework.name yarn yarn-site.xml

yarn.nodemanager.aux-services mapreduce_shuffle

yarn.nodemanager.aux-services.mapreduce.shuffle.class org.apache.hahoop.mapred.ShuffleHandler hdfs-site.xml

需要再hadoop解压的根目录下创建一个data文件夹,并在data下创建namenode和datanode两个子文件夹;

然后添加配置文件 :

dfs.replication 1

dfs.permissions false

dfs.namenode.name.dir /F:/Environment/hadoop-3.1.2/hadoop/data/namenode

fs.checkpoint.dir /F:/Environment/hadoop-3.1.2/hadoop/data/snn

fs.checkpoint.edits.dir /F:/Environment/hadoop-3.1.2/hadoop/data/snn

dfs.datanode.data.dir /F:/Environment/hadoop-3.1.2/hadoop/data/datanode

配置文件修改完毕 !

三、替换bin文件

下载的Hadoop不支持Windows系统,需要替换bin目录下的文件方便在Windows上运行。这也是掉坑来的地方了!!!!
在网上下载到的hadooponwindows-master.zip 以及winutils中应该是只适合hadoop 3.0.0及其以下,尝试过hadooponwindows-master.zip以及winutils中最高的版本3.0.0,启动hadoop都会出现下面的错误:Error starting NodeManager、UnsatisfiedError


折腾了好久(低版本的hadoop还没下载完毕),终于找到3.1.0版本winutils,下载后直接替换掉hadoop目录下bin文件即可:



复制yarn的jar包

可以看到resourcemanager.ResourceManager: Error starting ResourceManager启动失败的日志
报了类TimelineCollectorManager找不到的错误。

解决方法:
F:\Environment\hadoop-3.1.2\hadoop\share\hadoop\yarn\timelineservice
将这个文件夹下的hadoop-yarn-server-timelineservice-3.1.2.jar 包
复制到这个路径下 F:\Environment\hadoop-3.1.2\hadoop\share\hadoop\yarn 即可解决。
 

四、格式化HDFS文件系统

hdfs namenode -format

如果这一步没有什么异常基本没有问题了。

启动

进入hadoop的sbin目录我这里在 : F:\Environment\hadoop-3.1.2\hadoop\sbin# 启动# 会自动开启四个新的命令行窗口,窗口没打印异常即启动成功start-all# 停止stop-all# 查看正在运行的实例进程及端口jps

这四个窗口不能关闭 , 否则进程会结束



五、访问管理GUI

启动成功后,可以访问GUI页面

http://localhost:8088

http://localhost:9870

最后我们停止一下所有进程



写在最后:

运行结束后你会发现hadoop安装的磁盘根目录下多了一个tmp临时文件目录

里面有一些 Hadoop的缓存文件 ,不需要的话可以清理一下的。



以上就是这次Winwin7小编关于在Win10系统下安装Hadoop详细部分分享了,希望大家能喜欢哦。


返回顶部


18183游戏网发布的系统镜像及软件均来至互联网,仅供学习和研究使用,不得用于任何商业用途并请在下载后24小时内删除,如果满意请联系版权方购买。
如果您发现本站侵害了您的版权,请立即联系我们,本站将第一时间进行相关处理。投诉邮箱1524578900@qq.com
版权声明|联系我们 Copyright © 18183游戏网 All Rights Reserved 鲁ICP备2021038877号-4

2.1147
基本信息
SQL
$_GET
$_POST
$_COOKIE
包含文件
自动加载
  1. 模型: /www/wwwroot/www.pjwan.com/lecms/model/
  2. 视图: /www/wwwroot/www.pjwan.com/view/ww7/w10_show.htm
  3. 控制器: /www/wwwroot/www.pjwan.com/lecms/control/show_control.class.php
  4. 日志目录: /www/wwwroot/www.pjwan.com/log/
  5. 当前页面: /www/wwwroot/www.pjwan.com/index.php
  6. 当前时间: 2026-08-21 16:44:12
  7. 当前网协: 216.73.216.186
  8. 请求路径: /win10jc/17423.html
  9. 运行时间: 2.1147
  10. 内存开销: 1.33 MB
  1. #0 [time:0.0003s] SELECT * FROM le_runtime WHERE k='cfg' LIMIT 1
  2. #1 [time:0.0002s] SELECT * FROM le_runtime WHERE k='website_group_18183_pjwan_com' LIMIT 1
  3. #2 [time:0.0003s] SELECT * FROM le_runtime WHERE k='cate_127' LIMIT 1
  4. #3 [time:0.0003s] SELECT * FROM le_cms_article WHERE id=17423 LIMIT 1
  5. #4 [time:0.0004s] SELECT * FROM le_user WHERE uid=2 LIMIT 1
  6. #5 [time:0.0069s] SELECT * FROM le_cms_article_data WHERE id=17423 LIMIT 1
  7. #6 [time:0.0003s] SELECT * FROM le_cms_article_views WHERE id=17423 LIMIT 1
  8. #7 [time:0.0003s] UPDATE LOW_PRIORITY le_cms_article_views SET views=views+1 WHERE id=17423 LIMIT 1
  9. #8 [time:0.0002s] SELECT id FROM le_cms_article WHERE id<17423 ORDER BY id DESC LIMIT 0,1
  10. #9 [time:0.0003s] SELECT * FROM le_cms_article WHERE id=17422
  11. #10 [time:0.0002s] SELECT id FROM le_cms_article WHERE id>17423 ORDER BY id ASC LIMIT 0,1
  12. #11 [time:0.0002s] SELECT * FROM le_cms_article WHERE id=17424
  13. #12 [time:0.0002s] SELECT * FROM le_kv WHERE k='navigate' LIMIT 1
  14. #13 [time:0.0003s] SELECT tagid,id FROM le_cms_article_tag_data WHERE tagid=552 ORDER BY id DESC LIMIT 0,11
  15. #14 [time:0.0005s] SELECT * FROM le_cms_article_tag_data WHERE tagid=552 AND id=103101 OR tagid=552 AND id=102870 OR tagid=552 AND id=102821 OR tagid=552 AND id=102820 OR tagid=552 AND id=102817 OR tagid=552 AND id=102792 OR tagid=552 AND id=102782 OR tagid=552 AND id=102769 OR tagid=552 AND id=102700 OR tagid=552 AND id=102631 OR tagid=552 AND id=102614
  16. #15 [time:0.0006s] SELECT * FROM le_cms_article WHERE id=103101 OR id=102870 OR id=102821 OR id=102820 OR id=102817 OR id=102792 OR id=102782 OR id=102769 OR id=102700 OR id=102631
  17. #16 [time:0.0004s] SELECT cid FROM le_category ORDER BY orderby ASC ,cid ASC
  18. #17 [time:0.0022s] SELECT * FROM le_category WHERE cid=1 OR cid=2 OR cid=3 OR cid=4 OR cid=5 OR cid=6 OR cid=7 OR cid=8 OR cid=9 OR cid=10 OR cid=11 OR cid=12 OR cid=13 OR cid=14 OR cid=15 OR cid=16 OR cid=17 OR cid=18 OR cid=19 OR cid=20 OR cid=21 OR cid=22 OR cid=23 OR cid=24 OR cid=25 OR cid=26 OR cid=27 OR cid=28 OR cid=29 OR cid=30 OR cid=31 OR cid=32 OR cid=33 OR cid=34 OR cid=35 OR cid=36 OR cid=37 OR cid=38 OR cid=39 OR cid=40 OR cid=41 OR cid=42 OR cid=43 OR cid=44 OR cid=45 OR cid=46 OR cid=47 OR cid=48 OR cid=49 OR cid=50 OR cid=51 OR cid=52 OR cid=53 OR cid=54 OR cid=55 OR cid=56 OR cid=57 OR cid=58 OR cid=59 OR cid=60 OR cid=61 OR cid=62 OR cid=63 OR cid=64 OR cid=65 OR cid=66 OR cid=67 OR cid=68 OR cid=69 OR cid=70 OR cid=71 OR cid=72 OR cid=73 OR cid=74 OR cid=75 OR cid=76 OR cid=77 OR cid=78 OR cid=79 OR cid=80 OR cid=81 OR cid=82 OR cid=83 OR cid=84 OR cid=85 OR cid=86 OR cid=87 OR cid=88 OR cid=89 OR cid=90 OR cid=91 OR cid=92 OR cid=93 OR cid=94 OR cid=95 OR cid=96 OR cid=97 OR cid=98 OR cid=99 OR cid=100 OR cid=101 OR cid=102 OR cid=103 OR cid=104 OR cid=105 OR cid=106 OR cid=107 OR cid=108 OR cid=109 OR cid=110 OR cid=111 OR cid=112 OR cid=113 OR cid=114 OR cid=115 OR cid=116 OR cid=117 OR cid=118 OR cid=119 OR cid=120 OR cid=121 OR cid=122 OR cid=123 OR cid=124 OR cid=125 OR cid=126 OR cid=127 OR cid=128
  19. #18 [time:0.0003s] SELECT id FROM le_cms_article_views WHERE cid=127 ORDER BY views DESC LIMIT 0,10
  20. #19 [time:0.0004s] SELECT * FROM le_cms_article_views WHERE id=20203 OR id=46928 OR id=46933 OR id=46920 OR id=46931 OR id=46927 OR id=46925 OR id=46926 OR id=45860 OR id=45636
  21. #20 [time:0.0006s] SELECT * FROM le_cms_article WHERE id=20203 OR id=46928 OR id=46933 OR id=46920 OR id=46931 OR id=46927 OR id=46925 OR id=46926 OR id=45860 OR id=45636
  22. #21 [time:0.0003s] SELECT * FROM le_runtime WHERE k='cate_85' LIMIT 1
  23. #22 [time:0.0007s] SELECT id FROM le_cms_win WHERE (cid=86 OR cid=87 OR cid=88 OR cid=89 OR cid=90 OR cid=91 OR cid=92 OR cid=93 OR cid=94 OR cid=95 OR cid=96 OR cid=97 OR cid=98 OR cid=99 OR cid=100) ORDER BY id DESC LIMIT 0,10
  24. #23 [time:0.0006s] SELECT * FROM le_cms_win WHERE id=1027 OR id=1026 OR id=1025 OR id=1024 OR id=1023 OR id=1022 OR id=1021 OR id=1020 OR id=1019 OR id=1018
  25. #24 [time:0.0002s] SELECT * FROM le_runtime WHERE k='cate_64' LIMIT 1
  26. #25 [time:0.0006s] SELECT id FROM le_cms_article WHERE (cid=65 OR cid=66 OR cid=67 OR cid=68 OR cid=125 OR cid=126 OR cid=127 OR cid=128) ORDER BY id DESC LIMIT 0,10
  27. #26 [time:0.0006s] SELECT * FROM le_cms_article WHERE id=103563 OR id=103562 OR id=103561 OR id=103560 OR id=103559 OR id=103558 OR id=103557 OR id=103556 OR id=103555 OR id=103554
  1. #control => show
  2. #action => index
  3. #cid => 127
  4. #id => 17423
  5. #mid => 2
    1. #acw_tc => 0819529e17873018508497395e08616874da9b5e3989004bedb0b3247b
    2. #cdn_sec_tc => 0819529e17873018508497395e08616874da9b5e3989004bedb0b3247b
    3. #PHPSESSID => crvmgo4bpuf9906aa333dofdur
    1. #0 /www/wwwroot/www.pjwan.com/index.php
    2. #1 /www/wwwroot/www.pjwan.com/lecms/xiunophp/xiunophp.php
    3. #2 /www/wwwroot/www.pjwan.com/lecms/config/config.inc.php
    4. #3 /www/wwwroot/www.pjwan.com/lecms/xiunophp/lib/base.func.php
    5. #4 /www/wwwroot/www.pjwan.com/lecms/xiunophp/lib/core.class.php
    6. #5 /www/wwwroot/www.pjwan.com/lecms/xiunophp/lib/debug.class.php
    7. #6 /www/wwwroot/www.pjwan.com/lecms/xiunophp/lib/log.class.php
    8. #7 /www/wwwroot/www.pjwan.com/lecms/xiunophp/lib/model.class.php
    9. #8 /www/wwwroot/www.pjwan.com/lecms/xiunophp/lib/view.class.php
    10. #9 /www/wwwroot/www.pjwan.com/lecms/xiunophp/lib/control.class.php
    11. #10 /www/wwwroot/www.pjwan.com/lecms/xiunophp/db/db.interface.php
    12. #11 /www/wwwroot/www.pjwan.com/lecms/xiunophp/db/db_pdo_mysql.class.php
    13. #12 /www/wwwroot/www.pjwan.com/lecms/xiunophp/cache/cache.interface.php
    14. #13 /www/wwwroot/www.pjwan.com/lecms/xiunophp/cache/cache_memcache.class.php
    15. #14 /www/wwwroot/www.pjwan.com/lecms/xiunophp/ext/network/Network__interface.php
    16. #15 /www/wwwroot/www.pjwan.com/lecms/config/plugin.inc.php
    17. #16 /www/wwwroot/www.pjwan.com/lecms/plugin/editor_sd/conf.php
    18. #17 /www/wwwroot/www.pjwan.com/lecms/plugin/editor_tinymce/conf.php
    19. #18 /www/wwwroot/www.pjwan.com/lecms/plugin/editor_um/conf.php
    20. #19 /www/wwwroot/www.pjwan.com/lecms/plugin/le_adminer/conf.php
    21. #20 /www/wwwroot/www.pjwan.com/lecms/plugin/le_baidu_zz/conf.php
    22. #21 /www/wwwroot/www.pjwan.com/lecms/plugin/le_category_filter/conf.php
    23. #22 /www/wwwroot/www.pjwan.com/lecms/plugin/le_content_tag_url/conf.php
    24. #23 /www/wwwroot/www.pjwan.com/lecms/plugin/le_data_table_split/conf.php
    25. #24 /www/wwwroot/www.pjwan.com/lecms/plugin/le_drafts/conf.php
    26. #25 /www/wwwroot/www.pjwan.com/lecms/plugin/le_feedback/conf.php
    27. #26 /www/wwwroot/www.pjwan.com/lecms/plugin/le_homepage_feign/conf.php
    28. #27 /www/wwwroot/www.pjwan.com/lecms/plugin/le_html_cache/conf.php
    29. #28 /www/wwwroot/www.pjwan.com/lecms/plugin/le_links/conf.php
    30. #29 /www/wwwroot/www.pjwan.com/lecms/plugin/le_minganci_do/conf.php
    31. #30 /www/wwwroot/www.pjwan.com/lecms/plugin/le_rand404content/conf.php
    32. #31 /www/wwwroot/www.pjwan.com/lecms/plugin/le_rand_author/conf.php
    33. #32 /www/wwwroot/www.pjwan.com/lecms/plugin/le_rand_pic_cid/conf.php
    34. #33 /www/wwwroot/www.pjwan.com/lecms/plugin/le_sharejs/conf.php
    35. #34 /www/wwwroot/www.pjwan.com/lecms/plugin/le_slide/conf.php
    36. #35 /www/wwwroot/www.pjwan.com/lecms/plugin/le_special_pro/conf.php
    37. #36 /www/wwwroot/www.pjwan.com/lecms/plugin/le_spider/conf.php
    38. #37 /www/wwwroot/www.pjwan.com/lecms/plugin/le_super_sitemap/conf.php
    39. #38 /www/wwwroot/www.pjwan.com/lecms/plugin/le_title_pic/conf.php
    40. #39 /www/wwwroot/www.pjwan.com/lecms/plugin/le_use_del_id/conf.php
    41. #40 /www/wwwroot/www.pjwan.com/lecms/plugin/le_webp_oss/conf.php
    42. #41 /www/wwwroot/www.pjwan.com/lecms/plugin/le_website_group/conf.php
    43. #42 /www/wwwroot/www.pjwan.com/lecms/plugin/le_zhanqunsitemaps_pro_v303/conf.php
    44. #43 /www/wwwroot/www.pjwan.com/lecms/plugin/lu_huochetou/conf.php
    45. #44 /www/wwwroot/www.pjwan.com/lecms/plugin/models_filed/conf.php
    46. #45 /www/wwwroot/www.pjwan.com/lecms/plugin/qrcode/conf.php
    47. #46 /www/wwwroot/www.pjwan.com/lecms/plugin/sy_mobile/conf.php
    48. #47 /www/wwwroot/www.pjwan.com/runcache/misc.func.php
    49. #48 /www/wwwroot/www.pjwan.com/runcache/core_lang/zh-cn.php
    50. #49 /www/wwwroot/www.pjwan.com/runcache/lang/zh-cn.php
    51. #50 /www/wwwroot/www.pjwan.com/runcache/lecms_control/parseurl_control.class.php
    52. #51 /www/wwwroot/www.pjwan.com/runcache/lecms_model/runtime_model.class.php
    53. #52 /www/wwwroot/www.pjwan.com/runcache/lecms_control/show_control.class.php
    54. #53 /www/wwwroot/www.pjwan.com/runcache/lecms_control/base_control.class.php
    55. #54 /www/wwwroot/www.pjwan.com/runcache/lecms_model/urls_model.class.php
    56. #55 /www/wwwroot/www.pjwan.com/runcache/lecms_model/category_model.class.php
    57. #56 /www/wwwroot/www.pjwan.com/runcache/lecms_model/cms_content_model.class.php
    58. #57 /www/wwwroot/www.pjwan.com/runcache/lecms_view/ww7,w10_show.htm.php
    59. #58 /www/wwwroot/www.pjwan.com/runcache/lecms_model/cms_content_data_model.class.php
    60. #59 /www/wwwroot/www.pjwan.com/runcache/lecms_model/cms_content_tag_model.class.php
    61. #60 /www/wwwroot/www.pjwan.com/runcache/lecms_model/user_model.class.php
    62. #61 /www/wwwroot/www.pjwan.com/runcache/lecms_model/cms_content_views_model.class.php
    63. #62 /www/wwwroot/www.pjwan.com/runcache/lecms_model/kv_model.class.php
    64. #63 /www/wwwroot/www.pjwan.com/runcache/lecms_model/cms_content_tag_data_model.class.php
    65. #64 /www/wwwroot/www.pjwan.com/lecms/xiunophp/tpl/sys_trace.php