{"id":38961,"date":"2019-01-25T00:00:00","date_gmt":"2019-01-24T16:00:00","guid":{"rendered":"https:\/\/case.ntu.edu.tw\/blog\/?p=38961"},"modified":"2022-01-04T08:39:54","modified_gmt":"2022-01-04T00:39:54","slug":"%e5%b7%a8%e9%87%8f%e8%b3%87%e6%96%99%e4%b9%8b%e6%96%bc%e5%8d%8a%e5%b0%8e%e9%ab%94%e8%a3%bd%e9%80%a0%ef%bc%9a%e5%84%b2%e5%ad%98%e5%8f%8a%e8%a8%88%e7%ae%97%e5%b9%b3%e5%8f%b0%e9%96%8b%e7%99%bc%e3%80%81","status":"publish","type":"post","link":"https:\/\/case.ntu.edu.tw\/blog\/?p=38961","title":{"rendered":"\u5de8\u91cf\u8cc7\u6599\u4e4b\u65bc\u534a\u5c0e\u9ad4\u88fd\u9020\uff1a\u5132\u5b58\u53ca\u8a08\u7b97\u5e73\u53f0\u958b\u767c\u3001\u7dad\u904b\u3001\u53ca\u4eba\u624d\u990a\u6210"},"content":{"rendered":"
\n
\"\u5de8\u91cf\u8cc7\u6599\u4e4b\u65bc\u534a\u5c0e\u9ad4\u88fd\u9020\uff1a\u5132\u5b58\u53ca\u8a08\u7b97\u5e73\u53f0\u958b\u767c\u3001\u7dad\u904b\u3001\u53ca\u4eba\u624d\u990a\u6210\"<\/div>\n<\/div>\n
\n
\n

\u8b1b\u8005\uff0f\u856d\u5b8f\u7ae0\uff08\u6210\u5927\u8cc7\u5de5\u7cfb\u6559\u6388\uff09\u2502\u5f59\u6574\uff0f\u300a\u79d1\u5b78\u4eba\u300b\u7de8\u8f2f\u5718\u968a
\n<\/strong>\u8f49\u8f09\u81ea2018.01.14\u3008\u79d1\u5275\u8b1b\u5802\uff0eICT\u8cc7\u901a\u8a0a\u79d1\u6280\u3009<\/strong><\/p>\n

\u897f\u51432000\u5e74\u5de6\u53f3\uff0c\u5927\u5bb6\u5c31\u5728\u8aaa\u6676\u7247\u6642\u8108\u4e0a\u4e0d\u53bb\uff0c\u6676\u7247\u88e1\u9762\u53ef\u4ee5\u88dd\u7684\u534a\u5c0e\u9ad4\u6578\u76ee\u5247\u8d8a\u4f86\u8d8a\u591a\u3002\u53e6\u4e00\u65b9\u9762\uff0cCPU\u88e1\u9762RAM\u7684\u5b58\u53d6\u901f\u5ea6\u5448\u6307\u6578\u6210\u9577\uff0c\u4f46\u78c1\u789f\u7684\u5b58\u53d6\u901f\u5ea6\u4e0a\u4e0d\u53bb\u3002\u5c31\u8cc7\u6599\u4f86\u8aaa\uff0c\u6578\u91cf\u4e00\u76f4\u589e\u52a0\uff0c\u660e\u5e74\u7684\u8cc7\u6599\u91cf\u662f\u4eca\u5e74\u7684K\u500d\uff0c\u5f8c\u5e74\u5247\u662f\u4eca\u5e74\u7684K2<\/sup>\u500d\uff0c\u5341\u5e74\u5f8c\u4f86\u770b\uff0c\u73fe\u5728\u7684\u8cc7\u6599\u91cf\u53ea\u6709\u4e00\u9ede\u9ede\u3002<\/span><\/p>\n

\u7d9c\u5408\u4e0a\u8ff0\u6240\u8a00\uff0c\u8cc7\u6599\u91cf\u4e00\u76f4\u589e\u52a0\uff0c\u4f46CPU\u8a08\u7b97\u901f\u5ea6\u4e0a\u4e0d\u53bb\uff0c\u8a18\u61b6\u9ad4\u7684\u901f\u5ea6\u4e0a\u4e0d\u53bb\uff0c\u78c1\u789f\u5b58\u53d6\u901f\u5ea6\u4e0a\u4e0d\u53bb\uff0c\u600e\u9ebc\u8fa6\uff1f\u89e3\u6c7a\u8fa6\u6cd5\u662f\u5e73\u884c\u66a8\u5206\u6563\u5f0f\u7cfb\u7d71\uff1a\u7531\u5e7e\u5341\u4e43\u81f3\u65bc\u5e7e\u842c\u53f0\u4f3a\u670d\u5668\u7d44\u6210\u7684\u4e00\u5957\u7cfb\u7d71\u3002\u300c\u5206\u6563\u300d\u662f\u6307\u7a7a\u9593\u8a08\u7b97\u548c\u5132\u5b58\u7684\u5206\u4f48\uff0c\u800c\u300c\u5e73\u884c\u300d\u662f\u6307\u5728\u6642\u9593\u4e0a\u540c\u6642\u57f7\u884c\u67d0\u4e00\u5206\u6563\u4efb\u52d9\u3002<\/p>\n

\u5e73\u884c\u66a8\u5206\u6563\u5f0f\u7cfb\u7d71\u5728\u5de8\u91cf\u8cc7\u6599\u65b9\u9762\u6700\u6709\u540d\u7684\u5c08\u6848\u5e73\u53f0\u662f\u958b\u6e90\uff08Open Source\uff09\u7684Hadoop\u3002Hadoop\u57282006\u5e74\u767c\u4f48\uff0c\u6709\u5f88\u591a\u5927\u516c\u53f8\u63a1\u7528\u3002\u5c31Hadoop\u7684\u8edf\u9ad4\u5806\u758a\u4f86\u8aaa\uff0c\u5e95\u4e0b\u662f\u6a94\u6848\u7cfb\u7d71\uff1b\u4e2d\u9593\u662f\u5206\u6563\u5f0f\u8cc7\u6599\u5eab\u3001\u7de8\u8b6f\u7a0b\u5f0f\uff0c\u53e6\u5916\u9084\u6709\u4e00\u4e9b\u8a08\u7b97\u6846\u67b6\u5982Spark\u3001MR\uff08MapReduce\uff09\uff0c\u4e2d\u9593\u9019\u90e8\u5206\u7a31\u70ba\u5e73\u53f0\u6838\u5fc3\uff1b\u4e0a\u9762\u5247\u662f\u61c9\u7528\u5c64\uff0c\u53ef\u505a\u6a23\u5f0f\u8fa8\u8b58\u3001\u5075\u932f\u544a\u8b66\u3001\u5099\u4efd\u7a3d\u6838\u7b49\u3002<\/p>\n

\u958b\u6e90\u8edf\u9ad4\u7684\u5408\u4f5c\u6a21\u5f0f<\/strong><\/p>\n

\u70ba\u4ec0\u9ebc\u8981\u7528\u958b\u653e\u539f\u59cb\u78bc\uff1f\u539f\u56e0\u5f88\u591a\uff0c\u4f8b\u5982\uff1a\u5b83\u514d\u8cbb\u800c\u81ea\u7531\u3001\u4e0d\u6703vendor lock-in\uff08\u4f9b\u61c9\u5546\u7d81\u5b9a\uff09\u3001\u958b\u767c\u901f\u5ea6\u5feb\u3001\u5167\u5bb9\u900f\u660e\u3001\u773e\u591a\u516c\u53f8\u7684\u5408\u4f5c\u57fa\u790e\uff0c\u540c\u6642\u4e5f\u662f\u570b\u5916\u7684\u696d\u754c\u6a19\u6e96\u3002<\/p>\n

Hadoop\u91cb\u51fa\u4e4b\u5f8c\uff0c\u76f8\u95dc\u5c08\u6848\u7684\u6578\u76ee\u5c31\u66b4\u589e\uff0c\u513c\u7136\u6210\u70ba\u4e00\u500b\u751f\u614b\u7cfb\uff0c\u6211\u5011\u5728\u88e1\u9762\u53ef\u4ee5\u627e\u5230\u5f88\u591a\u5de5\u5177\u3002\u570b\u969b\u5f88\u591a\u5927\u516c\u53f8\u4e5f\u90fd\u63a1\u7528Hadoop\uff0c\u5982\u5fae\u8edf\u3001\u96c5\u864e\u3001Facebook\u3001Google\u7b49\uff0c\u4e2d\u570b\u7684BAT\uff08\u767e\u5ea6\u3001\u963f\u91cc\u5df4\u5df4\u3001\u9a30\u8a0a\uff09\u4e5f\u662f\u3002<\/p>\n

\u856d\u5b8f\u7ae0\u5728\u5de8\u91cf\u8cc7\u6599\u5e73\u53f0\u65b9\u9762\u66fe\u548c\u4e00\u4e9b\u570b\u5167\u696d\u8005\u5408\u4f5c\uff0c\u4f8b\u5982\uff1a\u534a\u5c0e\u9ad4\u88fd\u7a0b\u5546\u3001\u9ad8\u901f\u516c\u8def\u6536\u8cbbETC\u3001IoT\u5ee0\u5546\u3002\u856d\u5b8f\u7ae0\u5718\u968a\u7684\u7d93\u71df\u6a21\u5f0f\u5982\u4e0b\uff1a\u5f9e\u958b\u6e90\u793e\u7fa4\u53d6\u5f97\u8edf\u9ad4\u4ee5\u670d\u52d9\u696d\u8005\uff0c\u696d\u8005\u6709\u7dad\u8b77\u9700\u6c42\u5c31\u627e\u7b2c\u4e09\u65b9\u767c\u884c\u5546\uff08\u5982Cloudera\uff09\uff0c\u5982\u679c\u696d\u8005\u6709\u56de\u994b\u610f\u898b\uff0c\u5718\u968a\u5c31\u56de\u904e\u982d\u4f86\u4fee\u6539\u958b\u6e90\u8edf\u9ad4\uff0c\u5c46\u6642\u767c\u884c\u5546\u6703\u8ddf\u958b\u6e90\u793e\u7fa4\u540c\u6b65\uff0c\u66f4\u65b0\u8edf\u9ad4\u3002<\/p>\n

\u5c31\u534a\u5c0e\u9ad4\u5ee0\u5546\u4f86\u8aaa\uff0c\u88e1\u9762\u6709\u5f88\u591a\u5206\u6790\u4eba\u54e1\uff08\u4f7f\u7528R\u8a9e\u8a00\uff09\uff0c\u4ed6\u5011\u8981\u99d5\u99ad\u65b0\u8208\u7684\u5206\u6563\u5f0f\u8a08\u7b97\u5e73\u53f0\u6709\u96e3\u5ea6\uff0c\u856d\u5b8f\u7ae0\u63d0\u51fa\u7684\u89e3\u6c7a\u65b9\u6848\u662fDRS\uff08Distributed R Computing Service\uff09\u3002DRS\u662f\u4e00\u500b\u985e\u4f3cMR\u7684\u8a08\u7b97\u6846\u67b6\uff0c\u80fd\u8b93R\u8a9e\u8a00\u5206\u6790\u7a0b\u5f0f\u5e73\u884c\u5316\uff0c\u4f46R\u8a9e\u8a00\u4e0d\u7528\u6539\u3002<\/p>\n

\u856d\u5b8f\u7ae0\u4e5f\u5e6b\u5fd9\u505a\u4e86\u5de8\u91cf\u8cc7\u6599\u7684Data Service\uff08\u8cc7\u6599\u670d\u52d9\uff09\uff0c\u56e0\u70ba\u534a\u5c0e\u9ad4\u5ee0\u5546\u7684\u5c08\u696d\u662f\u88fd\u9020\u6676\u5713\uff0c\u8981\u5f9e\u982d\u5b78Hadoop\u5be6\u5728\u592a\u8f9b\u82e6\uff0c\u856d\u6559\u6388\u5c31\u5e6b\u4ed6\u5011\u505a\u4e86middleware\uff08\u4e2d\u9593\u8edf\u9ad4\uff09\uff0c\u628aHadoop\u7684\u6280\u8853\u7d30\u7bc0\u96b1\u85cf\u8d77\u4f86\uff0c\u8b93\u4ed6\u5011\u66f4\u65b9\u4fbf\u5b58\u53d6Hadoop\u3002\u9019\u500b\u89e3\u6c7a\u65b9\u6848\u5c31\u662fHDS\uff08Web-Based Hadoop Data Service\uff09\uff0c\u662f\u4ee5http\u5354\u5b9a\u69cb\u6210\u7684\u7db2\u8def\u670d\u52d9\u3002<\/p>\n

DRS\u8207HDS\u9084\u6709\u984d\u5916\u7684\u7279\u8272\uff1a\u6c34\u5e73\u64f4\u5145\u3001\u5bb9\u932f\u3001\u8ca0\u8f09\u5e73\u8861\u3002DRS\u8207HDS\u90fd\u662fHadoop\u5e73\u53f0\u7684\u6838\u5fc3\u5c64\u3002<\/p>\n

\u4eba\u624d\u9700\u6c42\u5b54\u6025<\/strong><\/p>\n

\u81f3\u65bc\u5927\u578b\u958b\u6e90\u8edf\u9ad4\u7684\u958b\u767c\u898f\u6a21\uff0c\u55ae\u5c31\u5206\u6563\u5f0f\u8cc7\u6599\u5eabApache HBase\u4f86\u8aaa\uff0c\u5168\u7403\u6709150\u4f4dcontributor\uff08\u8ca2\u737b\u8005\uff09\u300150\u4f4dcommitter\uff08\u8ca2\u737b\u8f03\u591a\u7684\u4eba\uff09\uff0c\u5176\u4e2d\u5927\u6982\u53ea\u670910\u4f4dPMC\uff08\u5c08\u6848\u7ba1\u7406\uff09\u3002<\/p>\n

\u81f3\u65bc\u6211\u570b\u5728Hadoop\u7684PMC+committer\u624d\u4e03\u4f4d\uff0c\u5206\u6563\u5728\u4e0d\u540c\u7684\u5c08\u6848\u88e1\uff0c\u5176\u4e2d\u6709\u4e00\u534a\u662f\u570b\u5916\u4f01\u696d\u683d\u57f9\uff08Spark\u7684committer\u5c31\u662f\u5728Netflix\u5de5\u4f5c\uff09\uff0c\u800c\u856d\u5b8f\u7ae0\u7684\u5be6\u9a57\u5ba4\u57f9\u990a\u904e\u4e00\u4f4dHBase\u7684PMC+committer\u3002\u7531\u6b64\u53ef\u898b\uff0c\u6211\u5011\u5728\u5de8\u91cf\u8cc7\u6599\u958b\u6e90\u8edf\u9ad4\u7684\u4eba\u624d\u592a\u5c11\uff08\u4f46\u4f7f\u7528\u8005\u5f88\u591a\uff09\u3002<\/p>\n

\u856d\u5b8f\u7ae0\u6307\u51fa\uff0c\u570b\u5167\u7522\u5b78\u5408\u4f5c\u6a21\u5f0f\u591a\u534a\u662f\u59d4\u8a17\uff0c\u5171\u540c\u958b\u767c\u6bd4\u8f03\u5c11\u3002\u56e0\u6b64\uff0c\u696d\u8005\u5728\u5e73\u53f0\u5c64\u6216\u6838\u5fc3\u670d\u52d9\u5c64\u6240\u7d2f\u7a4d\u7684\u7d93\u9a57\u5c31\u4e0d\u591a\u3002\u5171\u540c\u958b\u767c\u7684\u597d\u8655\u5247\u662f\uff0c\u5e73\u53f0\u5f88\u7368\u7279\u7684\u8a71\uff0c\u61c9\u7528\u5c31\u6703\u7368\u7279\u3002\u6211\u570b\u5728\u5de8\u91cf\u8cc7\u6599\u958b\u6e90\u8edf\u9ad4\u7684\u4eba\u624d\u6975\u5ea6\u7f3a\u4e4f\uff0c\u6240\u4ee5\u9019\u500b\u7576\u4e0b\u662f\u9032\u5230\u793e\u7fa4\u5e6b\u5fd9\u8ca2\u737b\u7684\u597d\u6a5f\u6703\u3002\u856d\u5b8f\u7ae0\u5c31\u6253\u8da3\u5730\u8aaa\uff0c\u5b78\u751f\u8b8a\u6210committer\u6216PMC\u4e4b\u5f8c\uff0c\u4fe1\u7bb1\u5c31\u70b8\u958b\u4e86\uff0c\u56e0\u70ba\u4e00\u5806\u516c\u53f8\u958b\u9ad8\u85aa\u6436\u4eba\u3002<\/p>\n

(\u672c\u6587\u7531\u6559\u80b2\u90e8\u88dc\u52a9\uff62AI\u5831\u5831\u2500AI\u79d1\u666e\u63a8\u5ee3\u8a08\u756b\uff63\u53d6\u5f97\u7db2\u8def\u8f49\u8f09\u6388\u6b0a)<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

\u8b1b\u8005\uff0f\u856d\u5b8f\u7ae0\uff08\u6210\u5927\u8cc7\u5de5\u7cfb\u6559\u6388\uff09\u2502\u5f59\u6574\uff0f\u300a<\/p>\n","protected":false},"author":21,"featured_media":38963,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3772,3293],"tags":[6106,1045,6107],"aioseo_notices":[],"jetpack_featured_media_url":"https:\/\/case.ntu.edu.tw\/blog\/wp-content\/uploads\/2022\/01\/ICT_05.jpg","_links":{"self":[{"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/posts\/38961"}],"collection":[{"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=38961"}],"version-history":[{"count":1,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/posts\/38961\/revisions"}],"predecessor-version":[{"id":38964,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/posts\/38961\/revisions\/38964"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/media\/38963"}],"wp:attachment":[{"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=38961"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=38961"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=38961"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}