{"id":25463,"date":"2021-04-08T00:00:00","date_gmt":"2024-09-13T08:48:48","guid":{"rendered":"https:\/\/wordpress-583806-4798031.cloudwaysapps.com\/learning-for-ai\/"},"modified":"2024-11-15T16:21:31","modified_gmt":"2024-11-15T15:21:31","slug":"learning-for-ai","status":"publish","type":"post","link":"https:\/\/informator.se\/en\/learning-for-ai\/","title":{"rendered":"Learning for AI, and the other way too"},"content":{"rendered":"\n

A quote from neither Informator nor Tieturi, but from the Lancet<\/a> medical journal, April 2021: \u201cparticularly deep learning<\/strong>, has changed our lives (\u2026) deep learning systems capable of diagnosing skin cancer and fully autonomous AI approved for diabetic retinopathy screening (\u2026) A key concern is how should clinicians<\/strong> be educated in these advances <\/strong>and what roles <\/strong>they will assume in developing, validating, and implementing these technologies.\u201d<\/em><\/p>\n\n\n\n

An enterprise architect or training provider could hardly put it better, while Med and pharma<\/a> continue to drive a lion\u2019s share of new AI<\/a>.<\/p>\n\n\n\n

Bilinguality in terminology<\/strong><\/h3>\n\n\n\n

Having said that,<\/em> let\u2019s keep in mind it\u2019s a two-way street between two communities (medical & pharma, and AI & IT architecture) including some tricky \u201cjargon bilinguality\u201d on both sides, as is often the case in other domains too. Researchers, financial analysts, regional government authorities, power-grid planners, rail operators, and on it goes, are generally proficient in (and thus biased toward) classical statistics and its lingo<\/a> whereas the straggly roots of appliedAI-ish, aged 65+, span across business rules, data\/computer science, symbolic reasoning and object orientation, \u201csubsymbolic\u201d representations, explainability, knowledge management and elicitation, informatics, logic, set theory, search algorithms, and a dozen more.<\/p>\n\n\n\n

Although much of the machinery underlying AI, including ML (Machine Learning) and neural networks, uses statistics-based methods, it does so in an own non-classical way. During the first Covid wave in 2020, California governor Gavin Newsom told CBC<\/a> News: “It’s not a gross exaggeration when I say this \u2013 the old modeling is literally pen-to-paper in some cases. And then you put it into some modest little computer program and it spits a piece of paper out. I mean, this is a whole other level of sophistication and data collection (…) We are literally seeing into the future and predicting in real time, based on constant update of information where patterns are starting to occur before they become headlines\u201d. Harvard Medical School News & Research, March 2021<\/a>, sees adaptive learning as a key source of value added by ML systems, \u201c(\u2026) they rely on adaptive learning: with each exposure to new data, the algorithm gets better (\u2026) offering doctors accumulated knowledge from billions<\/em> of medical decisions, billions of patient cases, and billions of outcomes\u201d.<\/p>\n\n\n\n

Redefine roles<\/strong><\/h3>\n\n\n\n

This section of the \u201ctwo-way street\u201d is no less tricky than terminology gaps. It depends on the domain to be supported, line of business, number of employees, organization and enterprise architecture, degree of organizational learning, skills of the staff, collaboration culture (hierarchical or horizontal, formal or informal\/lean\/agile) etc. In most contexts, the key roles to upgrade in the first place are architect<\/a> roles<\/em>: enterprise, data, IT, where \u201cthe spider in the web\u201d is part of the job description. AI boosts both the business and the architects\u2019 daily work.<\/p>\n\n\n\n

Frameworks and pretrained neural networks (sourced from ModelZoo, MatLab, TensorFlow, and many others), for clearly delimited tasks, provide most often a fast lane through the role-shaping section too, and thus a viable gateway for ML into a variety of professions. Typical pretrained-for tasks are translation and NLP (Natural Language Processing), classification, pattern recognition, pattern matching, or event-series pattern matching. When you\u2019re on track, you can expect a marginal drop in output accuracy, but also a substantial plunge in lead time compared to untrained NN.<\/p>\n\n\n\n

A quick glance inside retraining the pretrained<\/strong><\/h3>\n\n\n\n

The weight values in neurons of an untrained <\/em>neural network are initiated to random <\/em>values, whereas in a pretrained <\/em>network, they\u2019ve already \u201csmart\u201d values learnt<\/em> from many training runs on large datasets. You only train them on the delta<\/em>, i.e data values that are typical of your particular subdomain. One subdomain (at a time), whenever a (back-prop) NN uses \u201ccatastrophic forgetting, CF<\/a>\u201d during retraining. For example, although your human brain <\/em>didn\u2019t forget about your piano keys while learning, say, the keyboard of your PC, your re<\/em>-trained NN <\/em>would forget a lot. In a nutshell: the retraining would overwrite <\/em>weight values that differ from its initial piano version (over the past few years however, methods to mitigate CF improved). Hence an architect\u2019s rule of thumb: as long as there\u2019s considerable CF, keep the NN dedicated to one subdomain each.<\/p>\n\n\n\n

X-ray with automatic <\/em>calculation of bone age. If retrained to calculate horses\u2019 age from teeth X-rays, we can expect quite some CF. Source: Wikip<\/a>e<\/a>dia<\/a>:<\/em><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

<\/a><\/p>\n\n\n\n

Summing up:<\/strong> Over the past 12 months, the Covid pandemic has triggered a wave of open science, open data, open-source libraries, and open frameworks. While approximately 4,000 new publications appear daily on PubMed.gov, AI helps readers to filter the (big) data, but also to speed up and improve their research or their daily work as clinicians.<\/p>\n\n\n\n

Stay safe!<\/p>\n\n\n\n

Related courses:<\/h4>\n\n\n\n