Why Content Governance May Matter More Than the Next AI Breakthrough


TL;DR

Rob Hanna of Precision Content says enterprise AI underperforms because organisations treat language like structured data. The real bottleneck is ungoverned documentation, and technical publications teams already have the skills to fix it.

Rob Hanna observes that many enterprise AI initiatives may be losing momentum because organizations continue to treat language like structured data while overlooking the systems that make knowledge reliable. The co-founder and CEO of Precision Content, a technical communications consultancy, says, “Longstanding technical publications teams already possess many of the capabilities needed to establish a scalable content supply chain that supports AI, although those teams aren’t always included in strategic AI discussions.

Conversations surrounding enterprise AI often focus on increasingly sophisticated models, expanding infrastructure, and new platform capabilities. Hanna observes a different pattern emerging inside organizations. “I’ve seen AI copilots produce inconsistent responses, enterprise search programs struggle to meet expectations, and customer service assistants deliver experiences that leave users wanting greater confidence in the information they receive,” he shares. From his perspective, these outcomes invite a broader discussion about the quality of the knowledge supporting AI instead of focusing exclusively on the technology itself.

That perspective can be viewed alongside an earlier technology cycle. During the chatbot surge Hanna witnessed between 2016 and 2018, expectations expanded rapidly. In 2018, it was projected that 25% of customer service operations would integrate virtual customer assistants by 2020, reflecting widespread confidence in conversational technologies.

The technology itself showed considerable promise, but many organizations discovered that existing documentation couldn’t consistently support meaningful customer interactions,” Hanna states. He believes today’s enterprise AI landscape echoes many of those earlier lessons because the underlying knowledge environment has often changed far more slowly than the technology designed to use it.

Several studies reinforce this broader pattern. A 2019 paper noted that while hundreds of thousands of task-focused chatbots were developed, successful deployments beyond relatively simple scenarios proved considerably more challenging than many anticipated. A 2021 study examining 103 real-world chatbots likewise identified outdated, incomplete, and poorly maintained knowledge as recurring contributors to implementation difficulties.

According to Hanna, these findings suggest that conversational technologies often depend as much on trusted source material as on advances in software. He believes this history also highlights an important distinction between simply possessing documentation versus possessing usable knowledge.

Hanna notes that many organizations maintain extensive collections of manuals, policies, knowledge bases, training materials, and support resources. Yet those assets may exist across disconnected systems, follow inconsistent standards, or contain overlapping versions of the same information. AI systems drawing from those environments may therefore inherit uncertainty that already existed within the organization’s content ecosystem. “Hallucinations rarely begin inside the model,” Hanna explains. “They often begin much earlier, when nobody has established which information represents the trusted source of truth.

An example from the earlier chatbot era illustrates this principle. Hanna points to a food brand whose seasonal virtual assistant succeeded by focusing on a narrowly defined subject supported by decades of carefully maintained expertise. Instead of attempting to answer every conceivable question, the experience focused on authoritative guidance for a specific customer need. Hanna reflects, “It’s notably ironic that Butterball’s chatbot should still be held as the gold standard for successful conversational AI, when so many larger organizations have invested and have been unsuccessful. This demonstrates how success begins with carefully governed knowledge that reflects genuine expertise within a clearly defined domain.

chicken

This leads Hanna to another concern that he argues deserves greater executive attention. AI initiatives frequently originate within IT organizations or data science teams whose expertise emphasizes structured datasets, analytics, and computational models. While those capabilities remain essential, he suggests they sometimes encourage organizations to treat written knowledge as another data management exercise. Hanna draws a distinction between the two.

Data is typically organized into structured fields for computation, while content consists of language, documentation, procedures, policies, and instructions designed to communicate meaning,” he explains. Since large language models learn patterns from written language, he emphasizes that they perform effectively when organizations prepare content in ways that reflect how language is created, governed, and maintained.

Precision Content has built its work around that philosophy by helping organizations turn fragmented documentation into structured, reusable content that serves both people and AI systems. Through structured authoring, metadata, reusable content components, governance frameworks, and component content management strategies, the company aims to help enterprises establish a reliable content supply chain capable of supporting evolving AI initiatives.

Hanna views this as an opportunity to elevate content operations from a publishing function into an important element of enterprise knowledge infrastructure. “Content deserves the same discipline organizations already apply to software development and data management,” he says. “Knowledge should be maintained as infrastructure, so AI can gain a much stronger foundation.

precision-content

For Hanna, this conversation also points toward a resource many organizations already possess. Technical publications teams routinely manage version control, structured authoring, taxonomy, metadata, reusable components, review workflows, and content lifecycle management. Those capabilities, he notes, align with what enterprise AI increasingly requires to retrieve reliable information at scale. Instead of searching exclusively for additional technology, Hanna stresses that organizations could begin by recognizing the expertise already available within their own documentation teams.

Ultimately, Hanna encourages leadership teams to broaden the questions guiding their strategies as enterprise AI continues to mature. He says, “We should ask: Which content is authoritative? Who owns enterprise knowledge? Where does organizational truth reside? Can documentation be interpreted consistently by both people and AI? And are technical publications participating in conversations about AI strategy from the beginning?” In Hanna’s view, thoughtful answers to those questions may contribute as much to long-term AI success as continued advances in the models themselves.



Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews


gettyimages-647882122

S847/iStock / Getty Images Plus

Follow ZDNET: Add us as a preferred source on Google.


ZDNET’s key takeaways

  • Staff who use AI can end up with more to do, not less.
  • Think carefully about the tools you’re using and why.
  • Adopt a set of standards and refine your outputs.

The promise of productivity boosts from AI can come with an unwelcome side order of stress. Harvard Business Review found that AI doesn’t reduce work; it intensifies it, leading to cognitive fatigue and unsustainable hours.

While the common perception is that AI can help reduce workloads, allowing employees to focus more on higher-value and more engaging tasks, HBR’s research found that staff using AI worked more quickly and often ended up with more to do, not less.

Also: Forget productivity: Here are 5 strategic shifts that drive real AI value

While we’ve written about how some professionals are finding ways to turn AI’s time-saving magic into a productivity superpower, we’ve also recognized that some employees have started to become tired with the low quality of AI outputs.

Ankur Anand, group CIO at tech recruiter Harvey Nash, said professionals who want to avoid cognitive fatigue must understand how to use AI effectively and its potential risks.

“That focus will help to reduce the noise around the workload that AI creates,” he told ZDNET, suggesting that many people have unrealistic expectations about the productivity boost that AI will provide.

Also: Why I ditched Copilot for Claude in Word, Excel, and PowerPoint – and how you can, too

“Many organizations are telling their people, ‘We want to understand how you’re making an impact with AI,'” he said. “But these professionals are not empowered, which means that using AI adds a lot of pressure, because they need to prove themselves on their own terms.”

If you’re going to make the most of AI at work, then you’re going to have to find an effective balance between completing tasks quickly and producing high-quality work. 

Here’s how the experts believe professionals can ensure they reap the benefits, not the problems, of AI — and they suggest that you’ll need to focus on three core areas: tools, guidelines, and outputs.

Limit your toolset

Alex Read, senior enterprise product manager for data at energy provider EDF UK, told ZDNET that the best way for professionals to reap the benefits, not the challenges, of AI is to be uber-focused on tools that help you produce value in your roles.

While there are thousands of potential AI-enabled services on the market, Read said sensible professionals limit their horizons.

Also: How this travel company’s AI rollout drove a 73% satisfaction boost: A 5-step playbook for your business

In his own role, for example, Read focuses on how AI can help him build a data platform and update information accurately, efficiently, and productively: “Anything outside of that scope is noise for me.”

That sentiment resonated with Nick Pearson, CIO at technology specialist Ricoh Europe, who told ZDNET it’s important to take a step back and think carefully about how an AI tool can help you produce value in your role.

“If you think about the phrase ‘gen AI,’ the tech is very good, by definition, at generating outputs,” he said. “I could go to bed in the evening, set the model to work, and we could have four new IT strategies produced overnight.”

Also: Worried AI agents will replace you? 5 ways you can turn anxiety into action at work

However, quantity doesn’t necessarily mean quality. Pearson suggested it’s important to focus on AI’s blind spots, particularly as most models are trained on preexisting content.

“AI can’t inspire people, per se; it can’t naturally create something new, because it’s actually quite recursive,” he said.

“And the judgment you have to put in sometimes, on top of everything else, whether it be an ethical or a capability judgment, is not there automatically in the technology.”

It’s in this gap, said Pearson, that human experts play a critical role: “We’re toying with that concern as an organization and saying, ‘Where does AI really play an important role, versus where are we upskilling people in areas that AI probably won’t play for a long time?'”

Work to the guidelines

HBR’s research found that an initial productivity surge when AI is adopted can lead to lower-quality work, turnover, and other problems as people work harder rather than smarter.

To correct this issue, HBR said companies need to adopt an “AI practice,” or a set of norms and standards around AI use that help professionals ensure they use AI in a constrained but productive manner.

Also: 90% of AI projects fail – here are 3 ways to ensure yours doesn’t

At EDF UK, Read is part of an internal AI Center of Excellence in enterprise IT, which enables policy for the effective use of AI across the wider organization. 

In addition to Read, who contributes input from a data-use perspective, the group includes other tech representatives, such as the firm’s senior manager of AI, principal software engineer, and principal solution architect.

“The remit of this center is to make sure that, when the federated business units are looking to build, develop, and deploy AI services, they have platforms, guidance, best practices, architectural assets, and materials to guide them on how to safely and efficiently adopt AI and operationalize it at scale,” he said.

Some of the key themes the center considers when assessing AI tools are scalability and reusability, ensuring a proposed service doesn’t replicate one already in use.

Also: 5 ways to use AI when your budget is tight

“All new tools and services related to AI will go through that hopper and funnel to understand scope and ensure the security, regulatory, and ethical side of things are understood,” he said, suggesting that all professionals should use their organization’s pre-existing guidelines to foster an appropriate exploitation of emerging tech.

“The benefit that guided approach brings is that it allows us to be clear in our messaging around what AI services can be used, how they’re used from a use-case perspective, and ultimately, what personas are allowed to use them.”

Refine your outputs

Even when tools are assessed and considered acceptable, there can still be an overreliance on AI outputs. Worse, some professionals can drown in the insights they receive, leading to higher stress and fewer benefits.

Louise Newbury-Smith, head of UK&I at technology specialist Zoom, told ZDNET that one way to ensure your outputs are constrained is to focus on prompting.

“Use simple amendments to be specific, such as ‘Give me the top three things with the biggest impact.’ That approach should guide your prompt, rather than saying, ‘Give me everything you know about this topic.'”

Also: 5 ways to fortify your network against the new speed of AI attacks

Newbury-Smith said the successful use of AI is all about being smart about how it’s exploited, and that effectiveness comes down to enablement and engagement. If a prompt yields too much information, refine it until you get what you need. She said this should still be faster than trying to get answers without AI.

The basic message for professionals is that effective applications of AI are all about you staying in the loop, said Bernhard Seiser, vice president of digital, data, and IT at AOP Health.

Think before you use AI, and think again before you push your outputs around the organization.

“It doesn’t help the business if you get AI-generated emails that are many pages long, and then you need ChatGPT to summarize the text,” he told ZDNET.

Seiser said that while there are certain tasks generative AI is good at and worth using for, in the end, “you need to use your brain.”





Source link