{"id":317,"date":"2026-04-17T17:32:21","date_gmt":"2026-04-17T17:32:21","guid":{"rendered":"https:\/\/www.ralfepoisson.com\/?p=317"},"modified":"2026-04-17T17:33:26","modified_gmt":"2026-04-17T17:33:26","slug":"why-capability-maturity-assessment-doesnt-work-and-why-genai-wont-fix-it-on-its-own","status":"publish","type":"post","link":"https:\/\/www.ralfepoisson.com\/index.php\/2026\/04\/17\/why-capability-maturity-assessment-doesnt-work-and-why-genai-wont-fix-it-on-its-own\/","title":{"rendered":"Why Capability Maturity Assessment Doesn\u2019t Work &#8211; And Why GenAI Won\u2019t Fix It (On Its Own)"},"content":{"rendered":"\n<p>Most organisations struggle with strategy execution. Not because they lack strategy &#8211; but because they lack a clear, continuous understanding of whether their organisation is actually capable of delivering it. This is exactly what capability maturity assessment is supposed to solve. And yet, in practice, it doesn\u2019t.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/www.ralfepoisson.com\/wp-content\/uploads\/2026\/04\/research-blog-header.png\"\/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">The uncomfortable reality<\/h2>\n\n\n\n<p>In theory, maturity assessments should be a core management tool. In practice, they are:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Infrequent (often annual or ad hoc)<\/li>\n\n\n\n<li>Partial (covering only a subset of capabilities)<\/li>\n\n\n\n<li>Weakly connected to actual decision-making<\/li>\n<\/ul>\n\n\n\n<p>In my recent research across Enterprise Architecture practitioners, this pattern was consistent:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>Capability maturity assessment is not embedded as a continuous discipline, it is episodic and tactical.<\/p>\n<\/blockquote>\n\n\n\n<p>That alone should give us pause. Because if something is genuinely valuable for strategy execution, it doesn\u2019t get used once a year. It\u2019s not about effort. The default explanation is simple: maturity assessments are too time-consuming. But that\u2019s not what the data shows. The biggest barriers are not: Time, Effort, or Tooling. They are:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Lack of management buy-in<\/li>\n\n\n\n<li>Limited perceived value<\/li>\n\n\n\n<li>Weak integration into governance<\/li>\n<\/ol>\n\n\n\n<p>In other words, organisations don\u2019t avoid maturity assessment because it\u2019s hard.<br>They avoid it because they don\u2019t believe it\u2019s worth doing. That is a very different problem.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">A deeper issue: we\u2019re measuring the wrong thing<\/h2>\n\n\n\n<p>Even when assessments are performed, there is a structural flaw. Most maturity models are process-centric. They measure formalisation, control, and compliance. But capabilities are not just processes. They are the combination of people, technology, data, and governance<\/p>\n\n\n\n<p>So what happens?<\/p>\n\n\n\n<p>We end up measuring how well things are documented and controlled, not how well they actually work. Which leads to a subtle but critical distortion: Organisations can appear \u201cmature\u201d while still being ineffective. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Enter GenAI \u2014 and the illusion of a solution<\/h2>\n\n\n\n<p>Generative AI seems to offer a way out. It promises: Faster assessments, Greater consistency, and the possibility of continuous evaluation. And to be fair, many practitioners see that potential. But here\u2019s the catch: The real constraint isn\u2019t analysis&#8230; It\u2019s trust.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The real bottleneck: data and legitimacy<\/h2>\n\n\n\n<p>Two things emerged very clearly:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Data quality is a major limiting factor<\/li>\n\n\n\n<li>Stakeholder trust does not follow from technical objectivity<\/li>\n<\/ol>\n\n\n\n<p>Even if GenAI produces consistent outputs, organisations still ask: Is the data reliable? Does this reflect reality? Can I defend this decision? As one practitioner put it: \u201cBad data in, bad data out.&#8221; (Although, perhaps those weren&#8217;t the exact words he used). GenAI doesn\u2019t remove the need for good data. It makes it unavoidable. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The more interesting insight<\/h2>\n\n\n\n<p>Perhaps the most important finding is this:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>There is a gap between the realised value of maturity assessment today and its intrinsic value under better conditions<\/p>\n<\/blockquote>\n\n\n\n<p>Most organisations don\u2019t get much value from current approaches, but they still believe that, if done properly, it should be valuable. That tension explains why maturity assessment persists\u2014despite underperforming in practice.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What actually needs to change<\/h2>\n\n\n\n<p>If we take this seriously, the solution is not just better tools or better models. It\u2019s a shift in how we think about maturity assessment altogether. From periodic, static diagnostics to continuous, strategy-linked capability management. That means:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Linking assessments directly to strategic objectives<\/li>\n\n\n\n<li>Embedding them into governance and delivery<\/li>\n\n\n\n<li>Triggering reassessment based on real change (not fixed cycles)<\/li>\n\n\n\n<li>Using GenAI to augment analysis (not replace judgement)<\/li>\n\n\n\n<li><\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">A final thought<\/h2>\n\n\n\n<p>GenAI is often positioned as the breakthrough. But in this case, it\u2019s more of a forcing function. It exposes the underlying problem: Capability maturity assessment has never really been treated as a core management system. Until that changes, making it faster or more automated won\u2019t fundamentally alter its impact. The real opportunity is not just to improve assessment. It is to rethink it entirely &#8211; as a continuous, integrated mechanism for managing strategy execution.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p><em>This article is based on a MSc master&#8217;s thesis. To read the full report in detail, <a href=\"https:\/\/www.ralfepoisson.com\/wp-content\/uploads\/2026\/04\/poisson-2026-capability-assessment-genai.pdf\">download it here<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Most organisations struggle with strategy execution. Not because they lack strategy &#8211; but because they lack a clear, continuous understanding of whether their organisation is actually capable of delivering it. This is exactly what capability maturity assessment is supposed to &hellip; <a href=\"https:\/\/www.ralfepoisson.com\/index.php\/2026\/04\/17\/why-capability-maturity-assessment-doesnt-work-and-why-genai-wont-fix-it-on-its-own\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[5,29],"tags":[60,63,64,62,65],"class_list":["post-317","post","type-post","status-publish","format-standard","hentry","category-engineering","category-thoughts","tag-ai","tag-ea","tag-enterprisearchitecture","tag-genai","tag-strategy"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9qLPS-57","_links":{"self":[{"href":"https:\/\/www.ralfepoisson.com\/index.php\/wp-json\/wp\/v2\/posts\/317","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ralfepoisson.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ralfepoisson.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ralfepoisson.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ralfepoisson.com\/index.php\/wp-json\/wp\/v2\/comments?post=317"}],"version-history":[{"count":3,"href":"https:\/\/www.ralfepoisson.com\/index.php\/wp-json\/wp\/v2\/posts\/317\/revisions"}],"predecessor-version":[{"id":320,"href":"https:\/\/www.ralfepoisson.com\/index.php\/wp-json\/wp\/v2\/posts\/317\/revisions\/320"}],"wp:attachment":[{"href":"https:\/\/www.ralfepoisson.com\/index.php\/wp-json\/wp\/v2\/media?parent=317"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ralfepoisson.com\/index.php\/wp-json\/wp\/v2\/categories?post=317"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ralfepoisson.com\/index.php\/wp-json\/wp\/v2\/tags?post=317"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}