{"id":37946,"date":"2021-01-15T00:00:33","date_gmt":"2021-01-14T16:00:33","guid":{"rendered":"https:\/\/case.ntu.edu.tw\/blog\/?p=37946"},"modified":"2021-12-27T10:18:23","modified_gmt":"2021-12-27T02:18:23","slug":"%e7%8d%a8%e8%a7%92%e7%8d%b870%e9%a6%ac30%e7%8a%80%e7%89%9b%e3%80%80%e4%b8%80%e5%bc%b5%e5%9c%96%e6%95%99%e6%9c%83ai%e4%b8%89%e7%a8%ae%e3%80%8c%e5%8b%95%e7%89%a9%e3%80%8d","status":"publish","type":"post","link":"https:\/\/case.ntu.edu.tw\/blog\/?p=37946","title":{"rendered":"\u7368\u89d2\u7378=70%\u99ac+30%\u7280\u725b\u3000\u4e00\u5f35\u5716\u6559\u6703AI\u4e09\u7a2e\u300c\u52d5\u7269\u300d"},"content":{"rendered":"
\n
\"\u7368\u89d2\u7378=70%\u99ac+30%\u7280\u725b\u3000\u4e00\u5f35\u5716\u6559\u6703AI\u4e09\u7a2e\u300c\u52d5\u7269\u300d\"<\/div>\n<\/div>\n
\n
\n

\u7de8\u8b6f\uff0f\u8a31\u5b88\u5091<\/strong><\/p>\n

\u66f4\u6709\u6548\u7387\u7684\u5b78\u7fd2\u65b9\u6cd5<\/strong><\/p>\n

\u50b3\u7d71\u7684\u6a5f\u5668\u5b78\u7fd2\u6a21\u578b\u8a13\u7df4\u65b9\u5f0f\u5341\u5206\u4ef0\u8cf4\u5927\u91cf\u7684\u5b78\u7fd2\u8cc7\u6599\uff0c\u4f8b\u5982\u70ba\u4e86\u4f7f\u6a21\u578b\u80fd\u5920\u8fa8\u5225\u4e00\u5339\u99ac\uff0c\u4fbf\u9700\u8981\u63d0\u4f9b\u6578\u5343\u5f35\u99ac\u7684\u5716\u50cf\uff0c\u9019\u4e0d\u50c5\u662f\u8a31\u591a\u4f01\u696d\uff08\u5c24\u5176\u662f\u8cc7\u6599\u53d6\u5f97\u3001\u5b58\u53d6\u4e0d\u6613\u7684\u9818\u57df\uff09\u9072\u9072\u4e0d\u9858\u6d89\u8db3AI\u7684\u4e3b\u8981\u539f\u56e0\u4e4b\u4e00<\/a>\uff0c\u4e5f\u662f\uff08\u76e3\u7763\u5f0f\uff09\u6a5f\u5668\u5b78\u7fd2\u8207\u4eba\u985e\u5b78\u7fd2\u6700\u5927\u7684\u4e0d\u540c\u4e4b\u8655\u3002<\/p>\n

\u5728\u4eba\u985e\u7684\u5b78\u7fd2\u904e\u7a0b\u4e2d\uff0c\u5e7c\u5152\u901a\u5e38\u53ea\u9700\u8981\u770b\u5c11\u91cf\uff08\u6709\u6642\u5019\u751a\u81f3\u5b8c\u5168\u4e0d\u9700\u8981\u4efb\u4f55\uff09\u7bc4\u4f8b\uff0c\u4fbf\u6709\u8fa6\u6cd5\u6b63\u78ba\u8fa8\u8b58\u4e00\u500b\u7269\u4ef6\u3002\u597d\u6bd4\u8aaa\u7d66\u5152\u7ae5\u5206\u5225\u770b\u4e00\u982d\u99ac\u548c\u4e00\u96bb\u7280\u725b\u7684\u7167\u7247\uff0c\u4e26\u4e14\u544a\u8a34\u4ed6\u7368\u89d2\u7378\u662f\u4e00\u7a2e\u4ecb\u65bc\u5169\u8005\u4e4b\u9593\u7684\u50b3\u8aaa\u52d5\u7269\uff0c\u5b69\u5b50\u4fbf\u53ef\u4ee5\u8f15\u6613\u8a8d\u51fa\u6545\u4e8b\u66f8\u63d2\u5716\u4e2d\u7684\u7368\u89d2\u7378\u3002<\/p>\n

\u4eba\u985e\u8207\u6a5f\u5668\u5728\u5b78\u7fd2\u6548\u80fd\u4e0a\u7684\u5de8\u5927\u5dee\u7570\uff0c\u5e36\u7d66\u4e86\u79d1\u5b78\u5bb6\u555f\u767c\uff1a\u6709\u6c92\u6709\u53ef\u80fd\u8b93AI\u6a21\u578b\u4e5f\u80fd\u50cf\u5c0f\u670b\u53cb\u4e00\u822c\u8070\u660e\uff0c\u53ea\u9700\u8981\u5c11\u5c11\u7684\u8a13\u7df4\u8cc7\u6599\u5c31\u80fd\u9054\u5230\u4e00\u6a23\u7684\u5b78\u7fd2\u6548\u679c<\/a>\u5462\uff1f\u52a0\u62ff\u5927\u6ed1\u9435\u76e7\u5927\u5b78\uff08University of Waterloo\uff09\u7684\u4e00\u7bc7\u65b0\u7814\u7a76\u5c07\u9019\u7a2e\u5b78\u7fd2\u65b9\u6cd5\u7a31\u70ba\u300cLO-shot\u5b78\u7fd2\u300d\uff08Less than One-shot learning\uff0c\u6bd4\u55ae\u6a23\u672c\u66f4\u5c11\u7684\u5b78\u7fd2\uff09\u3002<\/p>\n

\u8cc7\u6599\u84b8\u993e<\/strong><\/p>\n

\u4ee5\u5ee3\u53d7\u6b61\u8fce\u7684\u96fb\u8166\u8996\u89ba\u8cc7\u6599\u5eabMNIST\u70ba\u4f8b\u3002MNIST\u6536\u9304\u5404\u5f0f\u5404\u6a23\u7684\u624b\u5beb\u6578\u5b57\u5f71\u50cf\uff0c\u5f9e0\u52309\u51716\u842c\u7b46\u8cc7\u6599\uff0c\u5e38\u88ab\u7528\u4f86\u8a13\u7df4\u6216\u6e2c\u8a66\u65b0\u7684\u6a21\u578b\u3002\u5728\u904e\u5f80\u7684\u7814\u7a76\u4e2d\uff0c\u9ebb\u7701\u7406\u5de5\u5b78\u9662\u7684\u79d1\u5b78\u5bb6\u767c\u660e\u4e86\u4e00\u7a2e\u8cc7\u6599\u8403\u53d6\u6280\u8853\uff0c\u7d93\u904e\u7cbe\u5fc3\u8a2d\u8a08\u548c\u6700\u4f73\u5316\u5f8c\uff0c\u53ef\u4ee5\u5c07\u6574\u500bMNIST\u7684\u8cc7\u8a0a\u91cf\u4ee510\u5f35\u5f71\u50cf\u8868\u793a\uff08\u4e5f\u5c31\u662f\u5c07\u5927\u91cf\u8cc7\u6599\u6fc3\u7e2e\u70ba\u4e00\u5c0f\u7b46\u8cc7\u6599\uff09\u3002\u5169\u8005\u5c0d\u8a13\u7df4\u6216\u6e2c\u8a66\u4e00\u500b\u6a21\u578b\u800c\u8a00\u662f\u7b49\u6548\u7684\uff0c\u4e5f\u5c31\u662f\u8aaa\uff1a\u7528\u901910\u5f35\u5f71\u50cf\u8a13\u7df4\u51fa\u7684\u6a21\u578b\uff0c\u8207\u76f4\u63a5\u4f7f\u7528MNIST\u8a13\u7df4\u7684\u6a21\u578b\uff0c\u5728\u5716\u50cf\u8fa8\u8b58\u7684\u6e96\u78ba\u5ea6\u4e0a\u52e2\u5747\u529b\u6575\u3002<\/p>\n

\"\"<\/p>\n

\u5716\u4e00\u3001MIT\u79d1\u5b78\u5bb6\u5c07MNIST\u58d3\u7e2e\u5230\u50c5\u5269\u4e0b10\u5f35\u5f71\u50cf\u3002\uff08\u5716\u7247\u4f86\u6e90\uff1aTongzhou Wang et al., 2018.\uff09<\/p>\n<\/div>\n

\u6ed1\u9435\u76e7\u5927\u5b78\u7684\u7814\u7a76\u4eba\u54e1\u5e0c\u671b\u9032\u4e00\u6b65\u6539\u9032\u9019\u500b\u300c\u8cc7\u6599\u84b8\u993e\u300d\uff08data distillation\uff09\u7684\u904e\u7a0b\uff1a\u5982\u679c\u53ef\u4ee5\u5c076\u842c\u5f35\u5f71\u50cf\u7e2e\u6e1b\u523010\u5f35\uff0c\u70ba\u4ec0\u9ebc\u6211\u5011\u4e0d\u5c07\u5b83\u518d\u58d3\u7e2e\u52305\u5f35\u5462\uff1f\u4ed6\u5011\u767c\u73fe\u8a23\u7ac5\u5728\u65bc\u5275\u9020\u4e00\u500b\u540c\u6642\u5177\u6709\u591a\u500b\u6578\u5b57\u7279\u5fb5\u7684\u5f71\u50cf\uff0c\u5c31\u597d\u50cf\u300c\u7368\u89d2\u7378\u300d\u540c\u6642\u5177\u5099\u300c\u99ac\u300d\u548c\u300c\u7280\u725b\u300d\u7684\u7279\u5fb5\uff0c\u4f46\u672c\u8eab\u65e2\u975e\u300c\u99ac\u300d\uff0c\u4e5f\u975e\u300c\u7280\u725b\u300d\u4e00\u6a23\u3002<\/p>\n

\u8209\u4f8b\u4f86\u8aaa\uff0c\u4ee5\u5f80\u6211\u5011\u6703\u76f4\u63a5\u5c07\u300c3\u300d\u6a19\u8a3b\u70ba\u300c\u6578\u5b573\u300d\uff1b\u4f46\u300c3\u300d\u7684\u6a23\u5b50\u770b\u8d77\u4f86\u5176\u5be6\u8207\u6578\u5b57\u300c8\u300d\u6709\u5e7e\u5206\u76f8\u4f3c\uff0c\u8207\u6578\u5b57\u300c7\u300d\u76f8\u53bb\u751a\u9060\uff0c\u65bc\u662f\u6211\u5011\u53ef\u4ee5\u63db\u500b\u65b9\u5f0f\u544a\u8a34\u6a5f\u5668\uff1a\u9019\u500b\u5f71\u50cf\u662f60%\u7684\u6578\u5b573\u300130%\u7684\u6578\u5b578\u548c10%\u7684\u6578\u5b570\u3002\u9019\u7a2e\u300c\u8edf\u6a19\u7c64\u300d\uff08soft label\uff09\u5c31\u662f\u8cc7\u6599\u84b8\u993e\u7684\u95dc\u9375\uff0c\u4f7f\u5f97\u55ae\u4e00\u5716\u50cf\u53ef\u4ee5\u627f\u8f09\u66f4\u591a\u8cc7\u8a0a\u3002<\/p>\n

\u8edf\u6a19\u7c64\u7684\u9a5a\u4eba\u6210\u679c<\/strong><\/p>\n

\u7136\u800c\u55ae\u4e00\u5716\u50cf\u4e0a\uff0c\u6700\u591a\u53ef\u4ee5\u758a\u4e0a\u591a\u5c11\u985e\uff08category\uff09\u7684\u8edf\u6a19\u7c64\u5462\uff1f\u7b54\u6848\u662f\uff0c\u5e7e\u4e4e\u6c92\u6709\u4e0a\u9650\u3002\u7406\u8ad6\u4e0a\u6a21\u578b\u53ea\u9700\u8981\u5169\u7b46\u8cc7\u6599\uff0c\u5c31\u53ef\u4ee5\u5206\u51fa\u6578\u842c\u7a2e\u8cc7\u6599\u985e\u5225\u3002\u7814\u7a76\u4eba\u54e1\u5728\u6578\u5b78\u4e0a\u8b49\u660e\u4e86\u9019\u4e00\u9ede\uff0c\u4e26\u901a\u904e\u300ck-\u6700\u8fd1\u9130\u5c45\u6f14\u7b97\u6cd5\u300d\uff08k-Nearest Neighbor\uff0ckNN\uff0c\u6700\u7c21\u55ae\u7684\u6a5f\u5668\u5b78\u7fd2\u5206\u985e\u6cd5\u4e4b\u4e00\uff09\u6f14\u793aLO-shot\u5b78\u7fd2\u7684\u9a5a\u4eba\u6210\u6548\u3002<\/p>\n

\"\"<\/p>\n

\u5716\u4e8c\u3001\u4ee5\u300c\u984f\u8272\u300d\u53ca\u300c\u679c\u91cd\u300d\u5340\u5206\u300c\u860b\u679c\u300d\u8207\u300c\u6a58\u5b50\u300d\u5169\u985e\u6c34\u679c\u3002\uff08\u5716\u7247\u4f86\u6e90\uff1a \u6539\u7de8\u81eaMachine Leaning 101, Jason Mayes\uff09<\/p>\n<\/div>\n

\u4ec0\u9ebc\u662fkNN\uff1f\u9019\u88e1\u53ef\u4ee5\u5716\u4e8c\u7c21\u55ae\u89e3\u91cb\u3002\u6a6b\u8ef8\u7684\u300c\u984f\u8272\u300d\uff08colour\uff09\u8207\u7e31\u8ef8\u7684\u300c\u679c\u91cd\u300d\uff08weight\uff09\uff0c\u662f\u6211\u5011\u9078\u64c7\u7528\u4ee5\u5340\u5206\u300c\u860b\u679c\u300d\u8207\u300c\u6a58\u5b50\u300d\u5169\u7a2e\u6c34\u679c\u7684\u7279\u5fb5\u3002\u900f\u904e\u89c0\u5bdf\u8207\u79e4\u91cd\uff0c\u6211\u5011\u53ef\u4ee5\u5c07\u624b\u908a\u78ba\u5b9a\u7a2e\u985e\u7684\u6c34\u679c\u6a19\u793a\u5728\u5716\u4e2d\uff0c\u4f8b\u5982\u7d05\u3001\u7da0\u5206\u5225\u662f\u7d05\u8272\u8207\u7da0\u8272\u7684\u860b\u679c\uff0c\u6a58\u8272\u8cc7\u6599\u9ede\u4ee3\u8868\u6a58\u5b50\uff08\u8a13\u7df4\u8cc7\u6599\uff09\u3002\u7070\u8272\u9ede\uff0c\u5247\u662f\u4e00\u9846\u984f\u8272\u8207\u679c\u91cd\u5df2\u77e5\uff0c\u4f46\u7a2e\u985e\u672a\u77e5\u7684\u6c34\u679c\uff1b\u6309\u7167\u5b83\u5728\u5e73\u9762\u4e0a\u7684\u4f4d\u7f6e\uff0c\u7531\u65bc\u96e2\u5b83\u6700\u8fd1\u7684\u9130\u5c45\u662f\u7da0\u8272\u8cc7\u6599\u9ede\uff08\u7da0\u860b\u679c\uff09\uff0c\u6240\u4ee5\u6211\u5011\u63a8\u4f30\u61c9\u8a72\u4e5f\u662f\u4e00\u9846\uff08\u7da0\uff09\u860b\u679c\uff0c\u9019\u5c31\u662fkNN\u7684\u5206\u985e\u539f\u7406\u3002<\/p>\n

\u5982\u679c\u50cf\u7070\u8272\u9ede\u9019\u6a23\u7684\u53d6\u6a23\u9ede\u5920\u591a\uff0c\u6211\u5011\u5c31\u53ef\u4ee5\u756b\u51fa\u7d05\u3001\u7da0\u3001\u6a58\u4e09\u8005\u5404\u81ea\u5728\u5716\u4e8c\u9019\u5f35\u4e8c\u7dad\u5e73\u9762\u4e0a\u6240\u4f54\u64da\u7684\u5340\u57df\u3002\u7814\u7a76\u4eba\u54e1\u767c\u73fe\uff1a\u900f\u904e\u64cd\u7e31\u8a13\u7df4\u8cc7\u6599\u7684\u8edf\u6a19\u7c64\uff0c\u6211\u5011\u53ef\u4ee5\u5728\u5206\u985e\u7a7a\u9593\u4e0a\u5207\u5272\u51fa\u4efb\u610f\u5e7e\u4f55\u8272\u584a\uff0c\u5373\u4f7f\u9060\u8d85\u904e\u8a13\u7df4\u8cc7\u6599\u7684\u6578\u91cf\u3002<\/p>\n

\"\"<\/a><\/p>\n

\u5716\u4e09\u3001 \u7814\u7a76\u4eba\u54e1\u4ee5kNN\u6f14\u793aLO-shot\u5b78\u7fd2\u7684\u6f5b\u529b\u3002\u900f\u904e\u64cd\u7e31\u8edf\u6a19\u7c64\uff08\u6bcf\u500b\u5e73\u9762\u53f3\u5074\u7684\u5713\u9905\u5716\uff09\uff0c\u53ef\u4ee5\u5728\u5e73\u9762\u4e0a\u756b\u51fa\u4efb\u610f\u5e7e\u4f55\u8272\u584a\uff08\u8cc7\u6599\u985e\u5225\u7684\u908a\u754c\u7dda\uff09\u3002\u53ef\u4ee5\u770b\u5230\u5283\u5206\u51fa\u7684\u985e\u5225\u6578\uff08\u8272\u584a\u6578\uff09\u6bd4\u8cc7\u6599\u9ede\u500b\u6578\u4f86\u5f97\u591a\u3002\uff08\u5716\u7247\u4f86\u6e90\uff1aIlia Sucholutsky et al., 2019.\uff09<\/p>\n<\/div>\n

\u7576\u7136\uff0c\u9019\u7a2e\u65b9\u6cd5\u9084\u662f\u6709\u5176\u5c40\u9650\u6027\uff0c\u6bd4\u5982\u8aaa\u5c6c\u6027\u8f03\u8907\u96dc\u7684\u8cc7\u6599\u96c6\uff0c\u8edf\u6a19\u7c64\u7684\u8a2d\u8a08\u4e5f\u6703\u8d8a\u56f0\u96e3\u3002\u4f46\u6700\u91cd\u8981\u7684\u662f\uff0cLO-shot\u5b78\u7fd2\u65b9\u5f0f\u5f9e\u6839\u672c\u4e0a\u6e1b\u5c11\u4e86\u8a13\u7df4\u4e00\u500bAI\u6a21\u578b\u6240\u9700\u7684\u8cc7\u6599\u91cf\uff0c\u89e3\u6c7aAI\u61c9\u7528\u7684\u982d\u865f\u554f\u984c\uff1b\u6b64\u5916\uff0c\u5b83\u9084\u53ef\u4ee5\u6539\u5584\u8cc7\u6599\u7684\u96b1\u79c1\u6027\uff0c\u56e0\u70ba\u9700\u8981\u500b\u4eba\u63d0\u4f9b\u7684\u8cc7\u8a0a\u91cf\u66f4\u5c11\u3002\u96a8\u8457\u9019\u6a23\u80fd\u5920\u5927\u5e45\u63d0\u5347\u6548\u7387\u7684\u65b0\u5275\u898b\u51fa\u73fe\uff0c\u76f8\u4fe1\u672a\u4f86\u7684\u6a5f\u5668\u4e5f\u80fd\u5728\u5b78\u7fd2\u4e0a\u66f4\u8cbc\u8fd1\u4eba\u985e\uff0c\u767c\u63ee\u66f4\u5927\u7684\u529f\u6548\uff01<\/p>\n

 <\/p>\n

\u7de8\u8b6f\u4f86\u6e90<\/strong><\/p>\n

K. Hao,\u00a0\u201cA radical new technique lets AI learn with practically no data\u201d<\/a>,\u00a0MIT Technology Review<\/em>, 2020.<\/p>\n

\u53c3\u8003\u8cc7\u6599<\/strong><\/p>\n

T. Wang et al.,\u00a0\u201cDataset distillation\u201d<\/a>,\u00a0arXiv.org<\/em>, 2018.<\/p>\n

(\u672c\u6587\u7531\u6559\u80b2\u90e8\u88dc\u52a9\u300cAI\u5831\u5831\u2500AI\u79d1\u666e\u63a8\u5ee3\u8a08\u756b\u300d\u57f7\u884c\u5718\u968a\u7de8\u8b6f)<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

\u5982\u4f55\u7528\u66f4\u5c11\u7684\u8cc7\u6599\u8a13\u7df4\u4e00\u500b\u6210\u529f\u7684AI\u6a21\u578b\uff1f\u5176\u5be6\u53ea\u8981\u6539\u8b8a\u904e\u53bb\u6a19\u8a3b\u8cc7\u6599\u7684\u65b9\u5f0f\u3002<\/p>\n","protected":false},"author":21,"featured_media":37947,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3772,3293],"tags":[5378,5379,5380,4135],"aioseo_notices":[],"jetpack_featured_media_url":"https:\/\/case.ntu.edu.tw\/blog\/wp-content\/uploads\/2021\/12\/unicorn-colorblocking.png","_links":{"self":[{"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/posts\/37946"}],"collection":[{"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=37946"}],"version-history":[{"count":1,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/posts\/37946\/revisions"}],"predecessor-version":[{"id":37948,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/posts\/37946\/revisions\/37948"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=\/wp\/v2\/media\/37947"}],"wp:attachment":[{"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=37946"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=37946"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/case.ntu.edu.tw\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=37946"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}