Share this article

Artificial intelligence can lead to poor business decisions for several reasons: * **Flawed Data:** AI systems learn from the data they are trained on. If this data is incomplete, biased, or inaccurate, the AI will make decisions based on this flawed information, leading to suboptimal outcomes. For example, if historical sales data has a bias against a particular demographic, an AI trained on this data might perpetuate that bias in future sales predictions. * **Lack of Context and Nuance:** AI algorithms are typically designed to identify patterns and make predictions based on quantifiable data. They often struggle to understand the broader business context, ethical considerations, or the subtle nuances that human decision-makers can grasp. This can lead to decisions that are logically sound based on the data but entirely impractical or detrimental in the real world. * **Over-reliance and 'Black Box' Problem:** Businesses might become overly reliant on AI recommendations without fully understanding how the AI arrived at its conclusions. If the AI's decision-making process is a "black box" (meaning it's opaque and difficult to interpret), it can be challenging to identify errors or to override the AI when human judgment suggests a different course of action. * **Inability to Adapt to Unforeseen Circumstances:** AI models are trained on past data and may not be equipped to handle entirely new or unforeseen market conditions, disruptions, or "black swan" events. Human intuition and adaptability are often crucial in such situations, and an AI might continue to make decisions based on outdated patterns. * **Ethical and Social Biases:** AI can inadvertently amplify existing societal biases present in the training data. This can lead to unfair or discriminatory decisions in areas like hiring, loan applications, or customer service, resulting in reputational damage and legal issues for the company. * **Misinterpretation of Results:** Business leaders might misinterpret the output of an AI. They might take its predictions as absolute truths rather than probabilities or recommendations, leading to incorrect strategic choices. * **Security and Manipulation Risks:** AI systems can be vulnerable to adversarial attacks, where malicious actors intentionally feed them manipulated data to trick them into making bad decisions. * **Costly Implementation and Maintenance:** While not directly a decision-making flaw, the significant cost and complexity of implementing and maintaining AI systems can sometimes outweigh the benefits if not managed effectively, leading to poor resource allocation decisions. Essentially, AI is a powerful tool, but without human oversight, critical thinking, and a deep understanding of its limitations, it can become a source of poor business decisions rather than a driver of success.

Today, many organisations are integrating AI into their decisions, content, or user journeys. The responses are fast, structured, often relevant. So much so that confusion sets in: the confusion of considering these systems as genuinely «intelligent».

This perception is not trivial. It directly influences the way decisions are made, sometimes overestimating the reliability of the results produced. Before relying on these tools, it is necessary to understand what they actually do... and what they don't.

What makes us overestimate the intelligence of AI

Since the advent of generative AI models, we seem to be increasingly confusing performance with understanding. We can't see the mechanics, so we imagine a mind. Our brains, unable to tolerate emptiness, attribute intention, reasoning or meaning where there is merely a statistical sequence.

There's nothing modern about this confusion; it arises as soon as an inert object borrows our codes: it's anthropomorphism. This phenomenon can also be found in military robotics. Some soldiers deployed with robot dogs develop a form of attachment to the robot. The robot moves forward, explores and returns. It repeats a stable, almost familiar behaviour. When it is destroyed, it is not just a tool that is lost: it is an imagined presence. As soon as a system works, reacts or responds, we lend it a form of intention.

ELIZA effect

The tendency to overestimate the capabilities of a conversational system and attribute to it an understanding or intelligence that it does not possess. Named after ELIZA, a programme created by Joseph Weizenbaum at MIT (1964-1966) which simulated a psychotherapist: although it merely manipulated linguistic patterns, its users confided intimate thoughts to it, convinced that it truly «understood» them. See the full definition

The rise of language models has only amplified this illusion: when an AI nuances, contextualises, or reformulates, our minds naturally lean towards the idea of reasoning. This cognitive mechanism is not neutral: in business, it can lead to granting AI a level of reliability or understanding that it does not possess.

Data sovereignty

The outsourcing and governance of AI have become strategic challenges for organisations integrating artificial intelligence solutions into their business processes. Behind a conversational tool or an automation engine lie infrastructures, training models, data flows and technical dependencies often operated by international players.

The main providers of models and clouds are now mainly based in the United States (such as OpenAI, Microsoft and Amazon Web Services), while China is developing its own ecosystems (Alibaba Cloud, Baidu). The European Union is attempting to regulate these uses via the AI Act and the RGPD, but the operational reality remains complex: data hosted outside the EU, cascading subcontracting, models trained on uncontrolled corpora. The risk is not only legal, but also strategic and reputational.

Technological dependence, loss of data sovereignty, difficulty in auditing models, uncertainties regarding the location of processing or the traceability of sources: without clear governance, AI becomes a blind spot in the information system and a strategic risk for organisations. This illusion of understanding not only poses a cognitive problem but also has very concrete consequences for how organisations integrate these technologies.

Regaining a clear head in the face of so-called «intelligent» technologies»

In this context, should all projects and strategy be entrusted to AI? The question is not so much whether to use it, but how to use it. The real risk would be to do so without reflection. The real risk is not using AI, but using it without a framework, without reflection and without arbitration.

We talk about «artificial intelligence», but the term is already shaping our perception. As soon as the word intelligence is mentioned, our minds spontaneously project human attributes: understanding, intention, discernment. Yet these systems have no consciousness, will or capacity for judgement. They calculate, correlate and predict. Recognising this cognitive mechanism in no way diminishes the usefulness of AI. It simply avoids attributing to it what it has never had: an intention, a responsibility, a form of mind.

The challenge is to maintain a clear-headed stance. Use AI for what it really is: an extremely powerful statistical tool, capable of amplifying analysis, speeding up production and automating certain tasks - but never of deciding in place of a manager. Digital maturity is not about delegating your judgement to the machine. It's about knowing exactly where its usefulness ends.

In a nutshell

A clear-sighted approach to artificial intelligence means accepting that, despite its name, AI is not an intelligence. It is a sophisticated statistical model, remarkable for what it allows, but devoid of subjectivity. Some of these solutions are hosted and provided by suppliers whose interests do not converge with those of the country or organisation. It is only by looking at AI for what it really is that we can decide on the place we want - or not - to give it.

Share this article