{"id":25484,"date":"2022-02-07T00:00:00","date_gmt":"2024-09-13T08:48:52","guid":{"rendered":"https:\/\/wordpress-583806-4798031.cloudwaysapps.com\/green-ai-versus-big-data-10-architectural-stepping-stones-to-new-avenues\/"},"modified":"2024-11-15T16:21:23","modified_gmt":"2024-11-15T15:21:23","slug":"green-ai-versus-big-data-10-architectural-stepping-stones-to-new-avenues","status":"publish","type":"post","link":"https:\/\/informator.se\/en\/green-ai-versus-big-data-10-architectural-stepping-stones-to-new-avenues\/","title":{"rendered":"Green AI versus Big Data: 10 Architectural Stepping Stones to New Avenues"},"content":{"rendered":"\n

<\/p>\n\n\n\n

A few years ago, a CTO from Ericsson mentioned a study of the cloud’s energy consumption worldwide, at an Open-House day at the Swedish Institute of Computer Science. By then, the total already equaled a large economy, sized Japan or Korea. Then he asked the audience to guess what the prevalent content consuming those gigawatts was. Only a handful of us got close. The top three were: selfies, pets, and food\u2026<\/em><\/p>\n\n\n\n

Contrary today, the benefits of (Deep) ML in serious apps such as medicine, pharma<\/a>, environment, city traffic, public transportation, logistics<\/a>, industry 4.0, and a dozen other domains, already by<\/strong> far outweigh<\/strong> ML\u2019s increased carbon footprint.<\/p>\n\n\n\n

Architects are the spiders on the web (pun intended) who can influence app-portfolio priorities as well as resource demand<\/strong>, and who are familiar with tightrope walks between resources and system-quality parameters in an SLA deal. I mentioned innovative algorithms in the last paragraphs of my last blog<\/a>. Below, five points for enterprise architects, plus another five for IT architects, will help you to further improve the \u201cgreen C\/B\u201d ratio:<\/p>\n\n\n\n

1.<\/strong> In the EA<\/strong> role, pay enough attention to the \u201cB<\/strong>\u201d in C<\/strong>ost\/B<\/strong>enefit estimates in ML initiatives.<\/p>\n\n\n\n

2<\/strong>. Let C\/B<\/strong> include both designing\/tuning and the rest of the entire pipeline<\/strong>, that is, DevOps for programmed (\u201ccognitive\u201d) AI and ML-Ops for ML; include both monetary terms and green terms.<\/p>\n\n\n\n

3.<\/strong> Include the current turn from off<\/strong>shoring to \u201con<\/strong>shoring,\u201d as a consequence of robotics and automation cutting the percentage of salaries in total costs plus cutting lengthy transports, communication, and logistic chains. Moreover, automation attracts manufacturing back to regions with greener energy and  much less KWh per MUSD GDP (see also \u201c3. Robotics outcompete offshoring<\/strong>\u201din this Informator blog<\/a>  from 2017, or this editorial by Henrik Westman in Swedish business daily Dagens Industri<\/a>, 2022).<\/p>\n\n\n\n

4.<\/strong> Prioritize explainability<\/strong> mechanisms<\/a> (XAI), customizable as far as possible, especially for testers and for subject-matter experts. It will help them to spot both errors<\/strong> and wasteful use of resources<\/strong>.<\/p>\n\n\n\n

5. <\/strong>Encourage eclectic teams<\/strong>. They\u2019re already doing a great job at BlueDot<\/a>, DeepMind<\/a>, BioNtech<\/a>\/InstaDeep, and hundreds of other AI-intensive firms.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

A new greener avenue in ML: <\/em><\/strong>the RETRO <\/strong>model outperforms its 20-30 times larger<\/strong> siblings in a standard NLP-benchmark test, based on texts from 16 different sources. Results diagram by Deep Mind<\/strong>.<\/em><\/p>\n\n\n\n

6.<\/strong> In the ITA<\/strong> role, try new approaches to Small Data<\/strong> (e.g. patients with an extremely rare diagnosis, or a severe engine-failure scenario that \u201calmost never\u201d happens\u2026) such as increasing the number of variables per object(instance) or the density of measurements in a time series generated by the same source. \u201cI had 200-300 million images. I\u2019ve also worked on problems where I had 10 images\u201d Andrew Ng (GoogleBrain, Stanford, and LandingAI) told the MIT Tech Review<\/a> in 2021.<\/p>\n\n\n\n

7<\/strong>. Try innovative ML algorithms<\/strong> that reduce the need for computing resources and energy by orders of magnitude. Federated<\/a><\/strong> Learning<\/strong> shrinks network footprint (up to -99%, in tests by Ericsson Research in 2019); standardization<\/a> initiatives will gradually make such frameworks and algorithms secure, unified, and trusted.<\/p>\n\n\n\n

8.<\/strong> Try ML paradigms that iteratively learn without big data, especially Reinforcement Learning.<\/strong><\/p>\n\n\n\n

9.<\/strong> Employ Edge<\/strong>(device) ML and computing, to cut server loads, network data volume, latency and to facilitate privacy (integrity of PII).<\/p>\n\n\n\n

10.<\/strong> Keep an eye on new \u201chybrid<\/strong>\u201d algorithms that tweak techniques from programmed AI, merging them with (Deep)ML in innovative ways like DeepStack<\/a><\/strong>.AI or DeepMind<\/a> RETRO<\/a> <\/strong>do (test results see diagram).<\/p>\n\n\n\n

Finally, there\u2019s nothing wrong with non-technical professions, but let\u2019s keep in mind that solutions to most green-tech problems are quite techy. Therefore, architects should take the lead in shaping the corporate Green-IT agenda (when we passed on the AI-agenda to non-technicians in 1990, it led into endless discussions and a decade of AI Winter; let\u2019s not repeat it – we\u2019ve been there, seen it, got the T-shirt J ).<\/p>\n\n\n\n

by <\/em>Milan Kratochvil<\/a><\/u><\/em><\/em><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

<\/a> <\/p>\n\n\n\n

Trainer at Informator, senior modeling and architecture consultant at <\/em>Kiseldalen\u2019s, m<\/em>ain author: UML Extra Light (Cambridge University Press) and Growing Modular (Springer). <\/em>Advanced UML2 Professional (OCUP<\/a> cert level 3\/3).<\/em><\/p>\n\n\n\n

Milan and Informator collaborate since 1996 on architecture, AI, rules, modeling, UML, requirements, and design. You can meet him this year at these courses <\/em>in English or Swedish (remote<\/strong> participation is offered, encouraged, and strongly recommended by epidemiology experts) <\/em>:<\/em><\/p>\n\n\n\n

AI, Architecture, and Machine Learning<\/a><\/em><\/em><\/p>\n\n\n\n

Agile Architechture Fundamentals<\/a><\/em><\/p>\n\n\n\n

Agile Modeling with UML<\/a><\/em><\/p>\n\n\n\n

Avancerad objektmodellering med UML<\/a><\/em><\/p>\n\n\n\n

(on demand: Modular Product Line Architecture<\/em> )<\/p>\n<\/span><\/span>\r\n

Milan Kratochvil\u00a0<\/span><\/span><\/h4>\r\n<\/span><\/span>","protected":false},"excerpt":{"rendered":"

A few years ago, a CTO from Ericsson mentioned a study of the cloud’s energy consumption worldwide, at an Open-House day at the Swedish Institute of Computer Science. By then, the total already equaled a large economy, sized Japan or Korea. Then he asked the audience to guess what the prevalent content consuming those gigawatts […]<\/p>\n","protected":false},"author":6,"featured_media":26654,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[570],"tags":[],"class_list":["post-25484","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blogg"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t