{"id":1715,"date":"2020-03-04T09:40:14","date_gmt":"2020-03-04T14:40:14","guid":{"rendered":"https:\/\/muutaa.com\/?p=1715"},"modified":"2021-12-22T15:43:11","modified_gmt":"2021-12-22T20:43:11","slug":"multimodal-machine-learning","status":"publish","type":"post","link":"https:\/\/muutaa.com\/fr\/multimodal-machine-learning\/","title":{"rendered":"Multimodal machine learning"},"content":{"rendered":"<div data-draftjs-conductor-fragment=\"{&quot;blocks&quot;:[{&quot;key&quot;:&quot;assnj&quot;,&quot;text&quot;:&quot;Are you aware of the distinction between machine learning and multimodal machine learning and how it applies to healthcare?&quot;,&quot;type&quot;:&quot;unstyled&quot;,&quot;depth&quot;:0,&quot;inlineStyleRanges&quot;:[],&quot;entityRanges&quot;:[],&quot;data&quot;:{}},{&quot;key&quot;:&quot;ekh1i&quot;,&quot;text&quot;:&quot;&quot;,&quot;type&quot;:&quot;unstyled&quot;,&quot;depth&quot;:0,&quot;inlineStyleRanges&quot;:[],&quot;entityRanges&quot;:[],&quot;data&quot;:{}},{&quot;key&quot;:&quot;bp8ph&quot;,&quot;text&quot;:&quot;The Consumer Technology Association defines Machine Learning (ML) as an enabling technology of AI that provides systems, using algorithms, data, tools, and techniques; the ability to learn and change without providing\/programming an explicit mathematic model for mapping input to output. Tadas Baltru\u0161aitis et al from Cornell University describe that multimodal machine learning on the other hand aims to build models that can process and relate information from multiple modalities modalities, including sounds and languages that we hear, visual messages and objects that we see, textures that we feel, flavors that we taste and odors that we smell. An example of multimodal machine learning in relation to a Knee Osteoarthritis patient might include raw radiographic data, clinical exam results and their medical history.&quot;,&quot;type&quot;:&quot;unstyled&quot;,&quot;depth&quot;:0,&quot;inlineStyleRanges&quot;:[{&quot;offset&quot;:0,&quot;length&quot;:35,&quot;style&quot;:&quot;UNDERLINE&quot;},{&quot;offset&quot;:289,&quot;length&quot;:48,&quot;style&quot;:&quot;UNDERLINE&quot;},{&quot;offset&quot;:711,&quot;length&quot;:19,&quot;style&quot;:&quot;UNDERLINE&quot;}],&quot;entityRanges&quot;:[{&quot;offset&quot;:0,&quot;length&quot;:35,&quot;key&quot;:0},{&quot;offset&quot;:289,&quot;length&quot;:48,&quot;key&quot;:1},{&quot;offset&quot;:711,&quot;length&quot;:19,&quot;key&quot;:2}],&quot;data&quot;:{}},{&quot;key&quot;:&quot;7jjsi&quot;,&quot;text&quot;:&quot;&quot;,&quot;type&quot;:&quot;unstyled&quot;,&quot;depth&quot;:0,&quot;inlineStyleRanges&quot;:[],&quot;entityRanges&quot;:[],&quot;data&quot;:{}},{&quot;key&quot;:&quot;c9lgq&quot;,&quot;text&quot;:&quot;Senior data scientist at Booz Allen Hamilton, Catherine Ordun, warns US Federal Health Agencies such as National Institutes of Health, the Centers for Disease Control and Prevention, the Defense Health Agency, the Food and Drug Administration to be aware of common unimodal thinking present in certain algorithms and to consider the value of taking multimodel machine learning approach.&quot;,&quot;type&quot;:&quot;unstyled&quot;,&quot;depth&quot;:0,&quot;inlineStyleRanges&quot;:[{&quot;offset&quot;:45,&quot;length&quot;:1,&quot;style&quot;:&quot;ITALIC&quot;},{&quot;offset&quot;:46,&quot;length&quot;:16,&quot;style&quot;:&quot;UNDERLINE&quot;}],&quot;entityRanges&quot;:[{&quot;offset&quot;:46,&quot;length&quot;:15,&quot;key&quot;:3}],&quot;data&quot;:{}},{&quot;key&quot;:&quot;9n2ac&quot;,&quot;text&quot;:&quot;&quot;,&quot;type&quot;:&quot;unstyled&quot;,&quot;depth&quot;:0,&quot;inlineStyleRanges&quot;:[],&quot;entityRanges&quot;:[],&quot;data&quot;:{}},{&quot;key&quot;:&quot;4rbd0&quot;,&quot;text&quot;:&quot;\u201cIt is critical to understand that not every AI use case, especially in healthcare, can be whittled down to a single type of data. Healthcare is an extraordinarily complex domain that requires information from many sources. Unimodal algorithms that may have impressive results in a computer lab often flounder when exposed to real-world health data and use cases. This is because unimodal AI is typically limited in its ability to be effective or to \u201cgeneralize\u201d across a broad range of inputs and applications. Humans, with our innate intelligence, generalize with great ease. We can recognize a cat, for example, regardless of how it may be portrayed in a picture or which breed of cat we are looking at. Conversely, AI algorithms struggle with generalizing because they are typically designed and trained to classify only certain types of data. As health agencies adopt AI for applications such as precision medicine, population health, and outcomes evaluation, they should consider aggregating data from multiple sources, such as time series data from Fitbits, textual data from social media, image data from MRIs and X-rays, and columnar data from lab results. Triangulating multiple modes of data produces better results in the form of improved accuracy, more generalizable algorithms, and better insights.\u201d&quot;,&quot;type&quot;:&quot;blockquote&quot;,&quot;depth&quot;:0,&quot;inlineStyleRanges&quot;:[],&quot;entityRanges&quot;:[],&quot;data&quot;:{}},{&quot;key&quot;:&quot;fl7fa&quot;,&quot;text&quot;:&quot;&quot;,&quot;type&quot;:&quot;unstyled&quot;,&quot;depth&quot;:0,&quot;inlineStyleRanges&quot;:[],&quot;entityRanges&quot;:[],&quot;data&quot;:{}},{&quot;key&quot;:&quot;d371e&quot;,&quot;text&quot;:&quot;Ordun underlines as well that today trained health professionals access and review multiple data sources to make their diagnosis or treatment recommendations. If AI is supposed to support them shouldn't it be done with a multimodal approach?&quot;,&quot;type&quot;:&quot;unstyled&quot;,&quot;depth&quot;:0,&quot;inlineStyleRanges&quot;:[],&quot;entityRanges&quot;:[],&quot;data&quot;:{}}],&quot;entityMap&quot;:{&quot;0&quot;:{&quot;type&quot;:&quot;LINK&quot;,&quot;mutability&quot;:&quot;MUTABLE&quot;,&quot;data&quot;:{&quot;url&quot;:&quot;https:\/\/shop.cta.tech\/products\/definitions-and-characteristics-of-artificial-intelligence&quot;,&quot;target&quot;:&quot;_top&quot;,&quot;rel&quot;:&quot;noopener noreferrer&quot;}},&quot;1&quot;:{&quot;type&quot;:&quot;LINK&quot;,&quot;mutability&quot;:&quot;MUTABLE&quot;,&quot;data&quot;:{&quot;url&quot;:&quot;https:\/\/arxiv.org\/abs\/1705.09406&quot;,&quot;target&quot;:&quot;_top&quot;,&quot;rel&quot;:&quot;noopener noreferrer&quot;}},&quot;2&quot;:{&quot;type&quot;:&quot;LINK&quot;,&quot;mutability&quot;:&quot;MUTABLE&quot;,&quot;data&quot;:{&quot;url&quot;:&quot;https:\/\/www.nature.com\/articles\/s41598-019-56527-3&quot;,&quot;target&quot;:&quot;_top&quot;,&quot;rel&quot;:&quot;noopener noreferrer&quot;}},&quot;3&quot;:{&quot;type&quot;:&quot;LINK&quot;,&quot;mutability&quot;:&quot;MUTABLE&quot;,&quot;data&quot;:{&quot;url&quot;:&quot;https:\/\/www.govexec.com\/management\/2020\/03\/federal-healthcare-agencies-case-better-ai-outcomes\/163464\/&quot;,&quot;target&quot;:&quot;_top&quot;,&quot;rel&quot;:&quot;noopener noreferrer&quot;}}}}\">\n<div class=\"jwLWP _2hXa7 _30PMG blog-post-text-font blog-post-text-color public-DraftStyleDefault-block-depth0 public-DraftStyleDefault-text-ltr\" data-block=\"true\" data-editor=\"editor\" data-offset-key=\"bhebe-0-0\">\n<div class=\"public-DraftStyleDefault-block public-DraftStyleDefault-ltr\" data-offset-key=\"bhebe-0-0\"><span data-offset-key=\"bhebe-0-0\">Are you aware of the distinction between machine learning and multimodal machine learning and how it applies to healthcare?<\/span><\/div>\n<\/div>\n<div class=\"jwLWP _2hXa7 _30PMG blog-post-text-font blog-post-text-color public-DraftStyleDefault-block-depth0 public-DraftStyleDefault-text-ltr\" data-block=\"true\" data-editor=\"editor\" data-offset-key=\"2h9t-0-0\">\n<div class=\"public-DraftStyleDefault-block public-DraftStyleDefault-ltr\" data-offset-key=\"2h9t-0-0\"><span data-offset-key=\"2h9t-0-0\">\u00a0<\/span><\/div>\n<\/div>\n<div class=\"jwLWP _2hXa7 _30PMG blog-post-text-font blog-post-text-color public-DraftStyleDefault-block-depth0 public-DraftStyleDefault-text-ltr\" data-block=\"true\" data-editor=\"editor\" data-offset-key=\"c4b7s-0-0\">\n<div class=\"public-DraftStyleDefault-block public-DraftStyleDefault-ltr\" data-offset-key=\"c4b7s-0-0\"><a class=\"_2qJYG blog-link-hashtag-color iPHwd _3Ul6g\" href=\"https:\/\/shop.cta.tech\/products\/definitions-and-characteristics-of-artificial-intelligence\" target=\"_top\" rel=\"noopener noreferrer\"><span data-offset-key=\"c4b7s-0-0\">The Consumer Technology Association<\/span><\/a><span data-offset-key=\"c4b7s-1-0\"> defines Machine Learning (ML) as an enabling technology of AI that provides systems, using algorithms, data, tools, and techniques; the ability to learn and change without providing\/programming an explicit mathematic model for mapping input to output. <\/span><a class=\"_2qJYG blog-link-hashtag-color iPHwd _3Ul6g\" href=\"https:\/\/arxiv.org\/abs\/1705.09406\" target=\"_top\" rel=\"noopener noreferrer\"><span data-offset-key=\"c4b7s-2-0\">Tadas Baltru\u0161aitis et al from Cornell University<\/span><\/a><span data-offset-key=\"c4b7s-3-0\"> describe that multimodal machine learning on the other hand aims to build models that can process and relate information from multiple modalities modalities, including sounds and languages that we hear, visual messages and objects that we see, textures that we feel, flavors that we taste and odors that we smell. An example of multimodal machine learning in relation to a <\/span><a class=\"_2qJYG blog-link-hashtag-color iPHwd _3Ul6g\" href=\"https:\/\/www.nature.com\/articles\/s41598-019-56527-3\" target=\"_top\" rel=\"noopener noreferrer\"><span data-offset-key=\"c4b7s-4-0\">Knee Osteoarthritis<\/span><\/a><span data-offset-key=\"c4b7s-5-0\"> patient might include raw radiographic data, clinical exam results and their medical history.<\/span><\/div>\n<\/div>\n<div class=\"jwLWP _2hXa7 _30PMG blog-post-text-font blog-post-text-color public-DraftStyleDefault-block-depth0 public-DraftStyleDefault-text-ltr\" data-block=\"true\" data-editor=\"editor\" data-offset-key=\"dc1or-0-0\">\n<div class=\"public-DraftStyleDefault-block public-DraftStyleDefault-ltr\" data-offset-key=\"dc1or-0-0\"><span data-offset-key=\"dc1or-0-0\">\u00a0<\/span><\/div>\n<\/div>\n<div class=\"jwLWP _2hXa7 _30PMG blog-post-text-font blog-post-text-color public-DraftStyleDefault-block-depth0 public-DraftStyleDefault-text-ltr\" data-block=\"true\" data-editor=\"editor\" data-offset-key=\"es66n-0-0\">\n<div class=\"public-DraftStyleDefault-block public-DraftStyleDefault-ltr\" data-offset-key=\"es66n-0-0\"><span data-offset-key=\"es66n-0-0\">Senior data scientist at Booz Allen Hamilton,<\/span> <a class=\"_2qJYG blog-link-hashtag-color iPHwd _3Ul6g\" href=\"https:\/\/www.govexec.com\/management\/2020\/03\/federal-healthcare-agencies-case-better-ai-outcomes\/163464\/\" target=\"_top\" rel=\"noopener noreferrer\"><span data-offset-key=\"es66n-1-0\">Catherine Ordun<\/span><\/a><span data-offset-key=\"es66n-2-0\">,<\/span><span data-offset-key=\"es66n-2-1\"> warns US Federal Health Agencies such as National Institutes of Health, the Centers for Disease Control and Prevention, the Defense Health Agency, the Food and Drug Administration to be aware of common unimodal thinking present in certain algorithms and to consider the value of taking multimodel machine learning approach.<\/span><\/div>\n<\/div>\n<div class=\"jwLWP _2hXa7 _30PMG blog-post-text-font blog-post-text-color public-DraftStyleDefault-block-depth0 public-DraftStyleDefault-text-ltr\" data-block=\"true\" data-editor=\"editor\" data-offset-key=\"76d32-0-0\">\n<div class=\"public-DraftStyleDefault-block public-DraftStyleDefault-ltr\" data-offset-key=\"76d32-0-0\"><span data-offset-key=\"76d32-0-0\">\u00a0<\/span><\/div>\n<\/div>\n<blockquote class=\"pjZF7 j7VHc Tfrwe blog-post-quote-font blog-post-quote-color blog-quote-border-color public-DraftStyleDefault-block-depth0 public-DraftStyleDefault-text-ltr\" data-block=\"true\" data-editor=\"editor\" data-offset-key=\"hqbl-0-0\">\n<div class=\"public-DraftStyleDefault-block public-DraftStyleDefault-ltr\" data-offset-key=\"hqbl-0-0\"><span data-offset-key=\"hqbl-0-0\">\u201cIt is critical to understand that not every AI use case, especially in healthcare, can be whittled down to a single type of data. Healthcare is an extraordinarily complex domain that requires information from many sources. Unimodal algorithms that may have impressive results in a computer lab often flounder when exposed to real-world health data and use cases. This is because unimodal AI is typically limited in its ability to be effective or to \u201cgeneralize\u201d across a broad range of inputs and applications. Humans, with our innate intelligence, generalize with great ease. We can recognize a cat, for example, regardless of how it may be portrayed in a picture or which breed of cat we are looking at. Conversely, AI algorithms struggle with generalizing because they are typically designed and trained to classify only certain types of data. As health agencies adopt AI for applications such as precision medicine, population health, and outcomes evaluation, they should consider aggregating data from multiple sources, such as time series data from Fitbits, textual data from social media, image data from MRIs and X-rays, and columnar data from lab results. Triangulating multiple modes of data produces better results in the form of improved accuracy, more generalizable algorithms, and better insights.\u201d<\/span><\/div>\n<\/blockquote>\n<div class=\"jwLWP _2hXa7 _30PMG blog-post-text-font blog-post-text-color public-DraftStyleDefault-block-depth0 public-DraftStyleDefault-text-ltr\" data-block=\"true\" data-editor=\"editor\" data-offset-key=\"2914t-0-0\">\n<div class=\"public-DraftStyleDefault-block public-DraftStyleDefault-ltr\" data-offset-key=\"2914t-0-0\"><span data-offset-key=\"2914t-0-0\">\u00a0<\/span><\/div>\n<\/div>\n<div class=\"jwLWP _2hXa7 _30PMG blog-post-text-font blog-post-text-color public-DraftStyleDefault-block-depth0 public-DraftStyleDefault-text-ltr\" data-block=\"true\" data-editor=\"editor\" data-offset-key=\"bba74-0-0\">\n<div class=\"public-DraftStyleDefault-block public-DraftStyleDefault-ltr\" data-offset-key=\"bba74-0-0\"><span data-offset-key=\"bba74-0-0\">Ordun underlines as well that today trained health professionals access and review multiple data sources to make their diagnosis or treatment recommendations. If AI is supposed to support them shouldn&#8217;t it be done with a multimodal approach?<\/span><\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Are you aware of the distinction between machine learning and multimodal machine learning and how it applies to healthcare? \u00a0 The Consumer Technology Association defines Machine Learning (ML) as an enabling technology of AI that provides systems, using algorithms, data, tools, and techniques; the ability to learn and change without providing\/programming an explicit mathematic model [&hellip;]<\/p>\n","protected":false},"author":203168979,"featured_media":1716,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","site-sidebar-layout":"default","site-content-layout":"default","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"disabled","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_wpcom_ai_launchpad_first_post":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"{title}\n\n{excerpt}\n\n{url}","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"_wpas_customize_per_network":false,"jetpack_post_was_ever_published":false},"categories":[1372],"tags":[],"class_list":["post-1715","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Multimodal Machine Learning | MUUTAA Blog | Where Healthcare Meets AI<\/title>\n<meta name=\"description\" content=\"Health professionals access multiple data sources to make diagnoses or treatment recommendations. AI support requires multimodal machine learning.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/muutaa.com\/fr\/multimodal-machine-learning\/\" \/>\n<meta property=\"og:locale\" content=\"fr_CA\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Multimodal Machine Learning | MUUTAA Blog | Where Healthcare Meets AI\" \/>\n<meta property=\"og:description\" content=\"Health professionals access multiple data sources to make diagnoses or treatment recommendations. AI support requires multimodal machine learning.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/muutaa.com\/fr\/multimodal-machine-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"MUUTAA\" \/>\n<meta property=\"article:published_time\" content=\"2020-03-04T14:40:14+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-12-22T20:43:11+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/muutaa.com\/wp-content\/uploads\/2021\/04\/multimodal.png\" \/>\n\t<meta property=\"og:image:width\" content=\"428\" \/>\n\t<meta property=\"og:image:height\" content=\"231\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"muutaa\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"muutaa\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimation du temps de lecture\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/\"},\"author\":{\"name\":\"muutaa\",\"@id\":\"https:\\\/\\\/muutaa.com\\\/#\\\/schema\\\/person\\\/0ad84933a30e32d1556461df9ad22c5e\"},\"headline\":\"Multimodal machine learning\",\"datePublished\":\"2020-03-04T14:40:14+00:00\",\"dateModified\":\"2021-12-22T20:43:11+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/\"},\"wordCount\":448,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/muutaa.com\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i0.wp.com\\\/muutaa.com\\\/wp-content\\\/uploads\\\/2021\\\/04\\\/multimodal.png?fit=428%2C231&ssl=1\",\"articleSection\":[\"blog\"],\"inLanguage\":\"fr-CA\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/\",\"url\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/\",\"name\":\"Multimodal Machine Learning | MUUTAA Blog | Where Healthcare Meets AI\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/muutaa.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/i0.wp.com\\\/muutaa.com\\\/wp-content\\\/uploads\\\/2021\\\/04\\\/multimodal.png?fit=428%2C231&ssl=1\",\"datePublished\":\"2020-03-04T14:40:14+00:00\",\"dateModified\":\"2021-12-22T20:43:11+00:00\",\"description\":\"Health professionals access multiple data sources to make diagnoses or treatment recommendations. AI support requires multimodal machine learning.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/#breadcrumb\"},\"inLanguage\":\"fr-CA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/#primaryimage\",\"url\":\"https:\\\/\\\/i0.wp.com\\\/muutaa.com\\\/wp-content\\\/uploads\\\/2021\\\/04\\\/multimodal.png?fit=428%2C231&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i0.wp.com\\\/muutaa.com\\\/wp-content\\\/uploads\\\/2021\\\/04\\\/multimodal.png?fit=428%2C231&ssl=1\",\"width\":428,\"height\":231},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/muutaa.com\\\/multimodal-machine-learning\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/muutaa.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Multimodal machine learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/muutaa.com\\\/#website\",\"url\":\"https:\\\/\\\/muutaa.com\\\/\",\"name\":\"MUUTAA\",\"description\":\"Decision Support for Healthcare Supply Chain\",\"publisher\":{\"@id\":\"https:\\\/\\\/muutaa.com\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/muutaa.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-CA\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/muutaa.com\\\/#organization\",\"name\":\"MUUTAA\",\"url\":\"https:\\\/\\\/muutaa.com\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\\\/\\\/muutaa.com\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/i2.wp.com\\\/muutaa.com\\\/wp-content\\\/uploads\\\/2021\\\/03\\\/Final-Logo-1.png?fit=2033%2C614&ssl=1\",\"contentUrl\":\"https:\\\/\\\/i2.wp.com\\\/muutaa.com\\\/wp-content\\\/uploads\\\/2021\\\/03\\\/Final-Logo-1.png?fit=2033%2C614&ssl=1\",\"width\":2033,\"height\":614,\"caption\":\"MUUTAA\"},\"image\":{\"@id\":\"https:\\\/\\\/muutaa.com\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/muutaa\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/muutaa.com\\\/#\\\/schema\\\/person\\\/0ad84933a30e32d1556461df9ad22c5e\",\"name\":\"muutaa\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/efa337b4782c364cd3657acc73030a21ec128eb1c5e919973b502c99b4258818?s=96&d=identicon&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/efa337b4782c364cd3657acc73030a21ec128eb1c5e919973b502c99b4258818?s=96&d=identicon&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/efa337b4782c364cd3657acc73030a21ec128eb1c5e919973b502c99b4258818?s=96&d=identicon&r=g\",\"caption\":\"muutaa\"},\"sameAs\":[\"http:\\\/\\\/muutaa.wordpress.com\"],\"url\":\"https:\\\/\\\/muutaa.com\\\/fr\\\/author\\\/muutaa\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Multimodal Machine Learning | MUUTAA Blog | Where Healthcare Meets AI","description":"Health professionals access multiple data sources to make diagnoses or treatment recommendations. AI support requires multimodal machine learning.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/muutaa.com\/fr\/multimodal-machine-learning\/","og_locale":"fr_CA","og_type":"article","og_title":"Multimodal Machine Learning | MUUTAA Blog | Where Healthcare Meets AI","og_description":"Health professionals access multiple data sources to make diagnoses or treatment recommendations. AI support requires multimodal machine learning.","og_url":"https:\/\/muutaa.com\/fr\/multimodal-machine-learning\/","og_site_name":"MUUTAA","article_published_time":"2020-03-04T14:40:14+00:00","article_modified_time":"2021-12-22T20:43:11+00:00","og_image":[{"width":428,"height":231,"url":"https:\/\/muutaa.com\/wp-content\/uploads\/2021\/04\/multimodal.png","type":"image\/png"}],"author":"muutaa","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"muutaa","Estimation du temps de lecture":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/muutaa.com\/multimodal-machine-learning\/#article","isPartOf":{"@id":"https:\/\/muutaa.com\/multimodal-machine-learning\/"},"author":{"name":"muutaa","@id":"https:\/\/muutaa.com\/#\/schema\/person\/0ad84933a30e32d1556461df9ad22c5e"},"headline":"Multimodal machine learning","datePublished":"2020-03-04T14:40:14+00:00","dateModified":"2021-12-22T20:43:11+00:00","mainEntityOfPage":{"@id":"https:\/\/muutaa.com\/multimodal-machine-learning\/"},"wordCount":448,"commentCount":0,"publisher":{"@id":"https:\/\/muutaa.com\/#organization"},"image":{"@id":"https:\/\/muutaa.com\/multimodal-machine-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/muutaa.com\/wp-content\/uploads\/2021\/04\/multimodal.png?fit=428%2C231&ssl=1","articleSection":["blog"],"inLanguage":"fr-CA","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/muutaa.com\/multimodal-machine-learning\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/muutaa.com\/multimodal-machine-learning\/","url":"https:\/\/muutaa.com\/multimodal-machine-learning\/","name":"Multimodal Machine Learning | MUUTAA Blog | Where Healthcare Meets AI","isPartOf":{"@id":"https:\/\/muutaa.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/muutaa.com\/multimodal-machine-learning\/#primaryimage"},"image":{"@id":"https:\/\/muutaa.com\/multimodal-machine-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/muutaa.com\/wp-content\/uploads\/2021\/04\/multimodal.png?fit=428%2C231&ssl=1","datePublished":"2020-03-04T14:40:14+00:00","dateModified":"2021-12-22T20:43:11+00:00","description":"Health professionals access multiple data sources to make diagnoses or treatment recommendations. AI support requires multimodal machine learning.","breadcrumb":{"@id":"https:\/\/muutaa.com\/multimodal-machine-learning\/#breadcrumb"},"inLanguage":"fr-CA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/muutaa.com\/multimodal-machine-learning\/"]}]},{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/muutaa.com\/multimodal-machine-learning\/#primaryimage","url":"https:\/\/i0.wp.com\/muutaa.com\/wp-content\/uploads\/2021\/04\/multimodal.png?fit=428%2C231&ssl=1","contentUrl":"https:\/\/i0.wp.com\/muutaa.com\/wp-content\/uploads\/2021\/04\/multimodal.png?fit=428%2C231&ssl=1","width":428,"height":231},{"@type":"BreadcrumbList","@id":"https:\/\/muutaa.com\/multimodal-machine-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/muutaa.com\/"},{"@type":"ListItem","position":2,"name":"Multimodal machine learning"}]},{"@type":"WebSite","@id":"https:\/\/muutaa.com\/#website","url":"https:\/\/muutaa.com\/","name":"MUUTAA","description":"Decision Support for Healthcare Supply Chain","publisher":{"@id":"https:\/\/muutaa.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/muutaa.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-CA"},{"@type":"Organization","@id":"https:\/\/muutaa.com\/#organization","name":"MUUTAA","url":"https:\/\/muutaa.com\/","logo":{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/muutaa.com\/#\/schema\/logo\/image\/","url":"https:\/\/i2.wp.com\/muutaa.com\/wp-content\/uploads\/2021\/03\/Final-Logo-1.png?fit=2033%2C614&ssl=1","contentUrl":"https:\/\/i2.wp.com\/muutaa.com\/wp-content\/uploads\/2021\/03\/Final-Logo-1.png?fit=2033%2C614&ssl=1","width":2033,"height":614,"caption":"MUUTAA"},"image":{"@id":"https:\/\/muutaa.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/muutaa"]},{"@type":"Person","@id":"https:\/\/muutaa.com\/#\/schema\/person\/0ad84933a30e32d1556461df9ad22c5e","name":"muutaa","image":{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/secure.gravatar.com\/avatar\/efa337b4782c364cd3657acc73030a21ec128eb1c5e919973b502c99b4258818?s=96&d=identicon&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/efa337b4782c364cd3657acc73030a21ec128eb1c5e919973b502c99b4258818?s=96&d=identicon&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/efa337b4782c364cd3657acc73030a21ec128eb1c5e919973b502c99b4258818?s=96&d=identicon&r=g","caption":"muutaa"},"sameAs":["http:\/\/muutaa.wordpress.com"],"url":"https:\/\/muutaa.com\/fr\/author\/muutaa\/"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/muutaa.com\/wp-content\/uploads\/2021\/04\/multimodal.png?fit=428%2C231&ssl=1","jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pcTFyz-rF","_links":{"self":[{"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/posts\/1715","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/users\/203168979"}],"replies":[{"embeddable":true,"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/comments?post=1715"}],"version-history":[{"count":1,"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/posts\/1715\/revisions"}],"predecessor-version":[{"id":1717,"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/posts\/1715\/revisions\/1717"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/media\/1716"}],"wp:attachment":[{"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/media?parent=1715"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/categories?post=1715"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/muutaa.com\/fr\/wp-json\/wp\/v2\/tags?post=1715"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}