{"id":25013,"date":"2019-11-22T00:00:00","date_gmt":"2024-09-13T08:48:09","guid":{"rendered":"https:\/\/wordpress-583806-4798031.cloudwaysapps.com\/intelligible-intelligence-deep-xai-still-more-rd-than-toolbox\/"},"modified":"2024-11-15T16:21:51","modified_gmt":"2024-11-15T15:21:51","slug":"intelligible-intelligence-deep-xai-still-more-rd-than-toolbox","status":"publish","type":"post","link":"https:\/\/informator.se\/en\/intelligible-intelligence-deep-xai-still-more-rd-than-toolbox\/","title":{"rendered":"Intelligible Intelligence: Deep XAI still more R&D than toolbox"},"content":{"rendered":"\n
\n
\n
\n

Most a<\/span>rchitectural tradeoffs are hard. So is the one between the accuracy of Deep Machine Learning (ML) and explainability\/transparency of explainable AI (XAI). Therefore, DARPA\u2019s initial XAI program is expected to run through 2021.<\/i><\/p>\n

\n
Few explainability<\/span><\/a> mechanisms have been extensively tested on humans, but current R&D indicates at least some (hybrid) tech to come in a couple of years.<\/span><\/div>\n
Several well-tried ML technologies work their way through (in steps) from a first random solution to satisfactory ones, and where possible, to an optimal one:<\/span><\/div>\n
\u00b7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 <\/span><\/span><\/span>Genetic Algorithms, by creating additional generations<\/span><\/div>\n
\u00b7\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 <\/span><\/span><\/span>Forests, by creating additional trees from the same data<\/span><\/div>\n
\u00b7\u00a0 \u00a0 \u00a0 \u00a0 <\/span><\/span><\/span>Deep Neural Networks, by a (cost) function<\/span><\/i> applied (in training) to outputs, based on how they differ from labeled data, and propagated back across all neurons\/synapses, to adjust weights <\/span><\/div>\n
\u00b7 \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span><\/span><\/span>Hybrids, by combination (the \u201cnew kid on the block\u201d).<\/span><\/div>\n
\u00a0<\/div>\n
<\/a><\/div>\n
\u00a0<\/div>\n
NASA Space Technology 5 antenna created by GA<\/span><\/a> (source: NASA.gov)<\/span><\/i><\/div>\n
\u00a0<\/div>\n
\u00a0<\/div>\n
GA and Forests are more than semi-intelligible, by their nature. However, now that deep learning feeds big data through NN that consist of multiple hidden layers of neurons (DNN), it arrives at very accurate solutions to complex multidimensional problems, but <\/i>at the same time at an inherent black box.<\/span><\/div>\n
A part of my post<\/span><\/a> from August is about random forests, which offer both<\/i> more transparency than DNN do plus <\/i>quite a degree of accuracy. Moreover, trees and NN are even cross-fertilized, to offer explainability without impeding accuracy, and there are already several flavors of this; to pick a handful:<\/span><\/div>\n
\u00b7 \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span><\/span><\/span>adding extraction of simplified explainable models (e.g. trees) onto black-box DNN <\/span><\/div>\n
\u00b7\u00a0 \u00a0 \u00a0 \u00a0 <\/span><\/span><\/span>local (instance-based) explanation of one use case at a time, with its input values, for example animating<\/span><\/a> & explaining its path layer-by layer (like most test tools do). <\/span><\/div>\n
\u00b7\u00a0 \u00a0 \u00a0 \u00a0 <\/span><\/span><\/span>soft trees, with NN-based leaf nodes, that perform better than trees induced directly from the same data<\/span><\/div>\n
\u00b7 \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/span><\/span><\/span>adaptive neural trees and deep neural decision forests that create trees (edges, splits, and leafs) , to outperform \u201cstandalone\u201d NN as well as trees\/forests that skip the combination.<\/span><\/div>\n
\u00a0 <\/span><\/span><\/div>\n
Explainability, transparency, and V&V are absolutely essential to users\u2019 reliance\/confidence in mission-critical AI. Therefore, whichever path or paths take us to up-and-running products, XAI is welcome.<\/span><\/span><\/div>\n<\/div>\n<\/div><\/div>\n<\/div><\/div>\n<\/div><\/div>\n\n\n\n

<\/p>\n<\/span><\/span>\r\n

Milan Kratochvil\u00a0<\/span><\/span><\/h4>\r\nTrainer at Informator, senior modeling and architecture consultant at Kiseldalen\u2019s, main author: UML Extra Light (Cambridge University Press) and Growing Modular (Springer), Advanced UML2 Professional (OCUP<\/a> cert level 3\/3).\u00a0<\/em>Milan\u00a0and Informator collaborate since 1996 on architecture, modelling, UML, requirements, rules\/AI, and design. You can meet\u00a0him at public courses (in English or Swedish) on AI, Architecture, and ML (T1913<\/a><\/strong>, in December or February), Architecture (T1101<\/a>, T1430<\/a>) or Modeling (T2715<\/a>,\u00a0T2716<\/a>).<\/em><\/span><\/span>","protected":false},"excerpt":{"rendered":"

Most architectural tradeoffs are hard. So is the one between the accuracy of Deep Machine Learning (ML) and explainability\/transparency of explainable AI (XAI). Therefore, DARPA\u2019s initial XAI program is expected to run through 2021.<\/p>\n","protected":false},"author":6,"featured_media":26024,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"footnotes":""},"categories":[571,570,922],"tags":[591,592],"class_list":["post-25013","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-blogg","category-blogi","tag-ai","tag-machine-learning"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t